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PREFACE 


The  work  described  in  this  report  was  authorized  under  the  U.S.  Army  Science 
and  Technology  Objective  (STO)  IV.ME.2004.03.  The  work  described  in  this  report  was  started 
in  January  2004  and  completed  in  June  2004. 

This  report  was  prepared  in  response  to  a  request  from  the  U.S.  Army  Center  for 
Environmental  Health  Research  (USACEHR)  to  develop  a  methodology  to  evaluate 
Environmental  Sentinel  Biomonitor  (ESB)  technologies  and  then  to  evaluate  and  downselect  the 
most  appropriate  ESB  technologies  to  further  develop  into  an  ESB  system. 

The  use  of  either  trade  or  manufacturers’  names  in  this  report  does  not  constitute 
an  official  endorsement  of  any  commercial  products.  This  report  may  not  be  cited  for  purposes 
of  advertisement. 

Registered  users  should  request  additional  copies  of  this  report  from  the  Defense 
Technical  Information  Center;  unregistered  users  should  direct  such  requests  to  the  National 
Technical  Information  Service. 


This  report  has  been  approved  for  public  release. 
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INITIAL  TECHNOLOGY  ASSESSMENT 
FOR  THE  ENVIRONMENTAL  SENTINEL  BIOMONITOR  (ESB)  SYSTEM 


1.  OVERVIEW 

1.1  Introduction. 

The  U.S.  Army  Center  for  Environmental  Health  Research  (USACEHR),  with 
support  from  Army  client  organizations  and  funding  from  Army  Science  and  Technology 
Objective  (STO)  IV.ME.2004.03,  is  developing  an  Environmental  Sentinel  Biomonitor  (ESB) 
system  to  provide  rapid  toxicity  identification  for  a  broad  spectrum  of  chemicals  in  water.  A 
critical  initial  phase  of  the  STO  is  to  test  and  evaluate  toxicity  sensor  technologies  (also  called 
ESB  system  technologies).  Because  there  are  a  number  of  potentially  feasible  technologies  that 
could  meet  the  goals  of  the  ESB  program,  a  downselect  will  be  performed  to  evaluate  these 
technologies  and  select  the  most  promising  technologies  for  further  development  as  part  of  an 
ESB  system. 

1.2  Background. 

The  focus  of  the  ESB  system  is  to  detect  toxicity  associated  with  non-mil  itarized 
chemicals  (i.e.,  toxic  industrial  chemicals  [TICs]  and  toxic  industrial  materials  [TIMs])  in  water. 

1.2.1  Problem  Being  Addressed/Problem  Definition. 

Deployed  U.S.  forces  face  the  possibility  of  drinking  water  exposed  to  a  wide 
range  of  toxic  industrial  or  agricultural  chemicals  as  a  result  of  normal  use  (e.g.,  farm  run-off), 
damaged  infrastructures,  accidental  spills,  or  deliberate  chemical  contamination  of  water. 
Unfortunately,  rapid  detection  capabilities  for  toxic  chemicals  in  water  are  limited  and  may  not 
provide  sufficient  warning  of  developing  toxic  hazards. 

1.2.2  How  the  ESB  System  Addresses  the  Problem. 

The  ESB  system  monitors  responses  of  biological  components  (e.g.,  cells,  tissues, 
or  whole  organisms)  exposed  to  water  and  provides  rapid  responses/wamings  should  toxic 
conditions  develop.  Cell-based  sensors  are  becoming  available  that  integrate  biological  systems 
with  electronic  monitoring,  facilitating  rapid  response  to  developing  toxicity  in  water  using  very 
small  systems. 

1.2.3  ESB  Program  Objectives  and  Goals. 

The  ESB  program  will  incorporate  current  toxicity  sensor  technologies  into  an 
ESB  system  having  size,  weight,  and  logistical  characteristics  suitable  for  a  range  of  Army 
requirements  that  will  complement  current  chemical  monitoring  systems  and  provide  rapid 
toxicity  identification  for  a  broad  spectrum  of  chemicals  in  water.  The  optimal  system  may  be  a 
complementary  set  of  toxicity  sensors,  which  would  provide  the  following: 
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•  Rapid  response.  Required  response  times  may  range  from  a  few  minutes 
to  an  hour  depending  upon  the  particular  Army  use  scenario. 

•  Sensitivity.  One  ESB  system  technology  may  not  adequately  detect  all 
TICs/TIMs.  The  evaluation  will  consider  not  only  which  toxicity  sensor  provides  the  best 
overall  response  to  the  test  chemicals,  but  also  which  set  of  sensors  can  complement  each  other 
by  filling  gaps  in  toxicity  response  for  individual  sensors  as  well  as  providing  mutual 
confirmation  of  a  toxic  response. 

1.2.4  Desire  to  Leverage  with  Other  Technologies. 

The  ESB  system  development  should  be  integrated  with  other  Army-  and  DoD- 
related  research  and  development  activities  for  water  analysis.  For  example,  ESB  system 
platform  development  could  leverage  work  that  has  already  been  performed  on  the  Joint  Service 
Agent  Water  Monitor,  particularly  in  the  areas  of  sample  preparation  and  delivery,  sensor 
platform  configuration,  and  data  analysis  and  display. 


2.  FY04  ESB  SYSTEM  INITIAL  TECHNOLOGY  ASSESSMENT  RESULTS 

The  downselection  plan  employs  a  logical,  structured  decision  analysis  process, 
and  the  results  and  rationale  are  documented  so  that  final  recommendations  can  be  readily 
explained  and  defended  (see  Appendix  A).  The  results  of  the  downselection  evaluation  process 
completed  to-date  are  described  below. 

2.1  Study/Evaluation  Team  Formed. 

An  evaluation  team  was  formed  in  the  fall  of  2003  to  conduct  the  downselect. 

The  team  is  led  by  Dr.  William  van  der  Schalie  (USACEHR)  and  Dr.  Thomas  Gargan  II  (GEO¬ 
CENTERS,  Inc.),  with  support  from  the  Decision  Analysis  Team  (DAT)  of  the  Edgewood 
Chemical  and  Biological  Center.  The  evaluation  team  is  made  up  of  Army  user  representatives 
(members  of  an  Integrated  Product  Team)  and  technical  experts  from  collateral  organizations  and 
academia  (see  Appendix  B  for  a  list  of  team  members  and  their  roles). 

The  user  representative’s  purpose  is  to  articulate  the  situations/scenarios  (e.g.,  a 
small  team  of  special  operation  forces  operating  in  the  hills  of  Afghanistan)  for  all  possible 
Army  users  of  the  ESB  system  technology.  They  know  what  the  end-user  needs  are  because 
they  have  the  same  experiences  and  knowledge  and/or  access  to  others  that  have  this  knowledge 
and  experience.  The  user  representatives  also  define  the  technical  requirements  for  the  ESB 
system  technology  for  each  scenario  (e.g.,  in  the  small  team  of  special  operation  forces  scenario, 
the  ESB  system  technology  must  operate  in  water  temperatures  between  0-60  degrees  Celsius). 
Their  final  task  is  to  help  develop  the  downselection  evaluation  model.  They  do  this  jointly  with 
the  technical  experts.  Although  the  user  representatives  have  primary  responsibility  for  model 
development,  the  technical  expert’s  input  is  important  because  they  provide  input  on  the 
technical  feasibility  of  criteria  and  measures  for  the  model. 
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The  technical  expert’s  purpose  is  to  be  knowledgeable  about  the  ESB  system 
technologies,  develop  any  needed  preliminary  models  and  help  develop  the  final  downselection 
evaluation  model,  and  then  assess  the  technologies  using  the  preliminary  model,  if  needed,  and 
the  final  downselection  evaluation  model. 

2.2  ESB  System  Use  Concepts/Applications. 

Several  Army  applications  for  an  ESB  system  were  identified  early  in  the  STO 
program  process.  These  include: 

•  Use  in  conjunction  with  the  Tactical  Water  Purification  System  (TWPS), 
including  evaluation  of  water  pre-  and  post-treatment  and  supporting  decisions  regarding  the 
suitability  of  using  a  freshwater  bypass  system.  The  ESB  system  is  consistent  with  a 
recommendation  in  the  Pre-Planned  Product  Improvement  section  of  the  TWPS  Operational 
Requirements  Document. 

•  Testing  water  produced  by  on-board  water  generation  equipment  in 
manned  ground  vehicles  being  developed  under  the  Future  Combat  System  program. 


•  Use  by  Preventative  Medicine  personnel  to  evaluate  potable  water  quality 
in  a  variety  of  situations. 

•  Use  at  Army  installations,  both  domestically  and  overseas,  to  evaluate 
source  and  drinking  water  quality. 

The  user  representatives  reviewed  the  above  Army  applications  and  identified 
others.  They  then  grouped  and  analyzed  these  applications  to  form  the  fewest  number  of 
scenarios  that  would  represent  all  identified  Army  applications.  This  was  done  through  an 
iterative  process,  and  resulted  in  four  basic  scenarios  to  represent  the  situations  in  which  the 
Army  operates.  Two  of  the  four  basic  scenarios  were  further  subdivided  by  type  of  water  tested 
and  collection  method  to  create  two  more  scenarios,  for  a  total  of  six. 

The  type  of  water  tested  could  either  be  raw  (i.e.,  water  that  has  not  been  treated 
with  any  mechanism  [e.g.,  filters]  or  chemicals  [e.g.,  chlorine])  or  treated  (e.g.,  water  treated 
with  a  TWPS,  hand-held  water  treatment  device,  or  chemicals). 

There  are  two  types  of  collection  methods.  In  the  “continuous  flow”  method,  for 
example,  the  water  must  be  tested  as  the  water  flows  inside  a  pipeline  from  ohe  point  to  the  next. 
The  ESB  system  using  the  continuous  flow  method  must  constantly  monitor  the  water  for 
contamination.  The  results  of  the  tests  need  to  be  available  in  near  real-time  in  order  to  prevent 
use  or  contamination  further  along  in  the  distribution  system.  The  “grab  sample”  method  is 
defined  as  procuring  water  from  a  source  and  then  testing  it  off-line.  The  water  needs  to  be 
collected  and  tested  before  it  is  used,  with  maximum  response  times  ranging  between  a  few 
minutes  to  an  hour. 
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2.2.1 


Six  Scenarios  Considered. 


2. 2. 1.1  Individual/Small  Team  Scenario. 

This  scenario  represents  one  soldier  or  a  small  team  of  soldiers  operating  remotely 
away  from  a  fixed  or  field/contingency  base  (e.g.,  a  small  team  of  soldiers  operating  remotely  in 
the  hills  of  Afghanistan  -  soldiers  are  flown  in  and  out  of  this  remote  location  every  14  days; 
they  must  procure  local  water  each  day). 

The  ESB  system  provides  the  individual  soldier  or  small  team  the  ability  to  test  a 
grab  sample  of  raw  or  treated  water  in  the  field  for  the  presence  of  toxic  chemicals  that  could 
cause  acute  health  effects  and  degrade  battlefield  readiness/performance.  The  soldier  could  test 
raw  water  from  a  surface  water  source  prior  to  disinfecting  and  drinking  it  or  test  water  that  has 
been  treated  using  a  hand-held  water  treatment  device.  This  gives  the  individual  soldier  an 
enhanced  capability  to  check  the  quality  of  his  personally  acquired/produced  water  before 
consuming  it.  The  ESB  system  would  be  used  in  emergency  situations  when  the  soldier  does  not 
have  access  to  a  doctrinally  treated  and/or  distributed  water  supply  and  must  acquire,  produce,  or 
purify  their  own  water  (e.g.,  initial  entry,  remote  site,  and  special  operation  forces  operations). 

2. 2. 1.2  Future  Combat  System  -  Manned  Ground  Vehicle  Scenario. 

This  scenario  is  similar  to  the  individual/small  team  scenario.  Instead  of  an 
individual  operating  with  only  what  they  can  carry  or  procure  locally  (e.g.,  local  untreated 
water),  the  soldiers  are  operating  with  a  vehicle.  This  vehicle  has  the  ability  to  generate  potable 
water  through  a  process  that  starts  with  capturing  the  emissions  of  the  vehicle.  The  purpose  of 
the  ESB  system  is  to  independently  verify  the  vehicle  is  producing  potable  water. 

2. 2. 1.3  Field/Contingency  Scenarios. 

These  two  scenarios  (differing  only  in  the  type  of  water  tested  and  collection 
method)  represent  a  field/contingency  operation  where  more  than  a  small  team  of  soldiers  is 
living  and  working,  for  more  than  15  days,  and  their  water  is  procured  from  a  questionable 
source  (quality/safety  of  water  is  not  known).  Normally  the  source  water  would  be  treated  using 
a  Reverse  Osmosis  Water  Purification  Unit  (ROWPU)  or  TWPS. 

2. 2. 1.3.1  Grab  Sample  to  Test  Raw  or  Treated  Water  Scenario. 

A  reconnaissance  team,  in  its  mission  to  find  a  suitable  source  of  water  for  the 
ROWPU  or  TWPS  units,  must  test  existing  water  sources  in  the  area  of  the  field/contingency 
base.  Also,  Preventative  Medicine  personnel  need  to  periodically  check  for  TICs/TIMs  in 
storage  tanks  and  distribution  systems.  The  objective  is  to  catch  accidental  or  intentional  spills, 
discharges  or  contamination. 
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2.2. 1.3.2 


Continuous  Flow  Sample  to  Test  Treated  Water  Scenario. 


Quartermaster  personnel  could  use  a  continuous  flow  ESB  system  to  monitor  both 
water  that  is  the  source  for  their  ROWPU  or  TWPS  as  well  as  the  water  produced  by  these 
units/sy  stems. 

2. 2.1.4  Fixed-Base  Scenarios. 

These  two  scenarios  (differing  only  by  type  of  water  tested  and  collection 
method)  represent  operations  at  an  existing  base  either  within  the  United  States  or  overseas.  In 
these  scenarios,  the  soldiers  obtain  their  drinking  water  from  water  treatment  plants  that  meet 
U.S.  quality  standards  (potable  water  is  not  being  created  with  a  ROWPU  or  TWPS).  The  water 
treatment  plant  could  be  located  either  on-base  or  off-base,  with  the  water  piped  in.  The 
population  will  be  less  homogeneous  than  the  other  scenarios  because  dependents  will  be  using 
the  water  supply. 

2.2. 1.4.1  Grab  Sample  to  Test  Raw  or  Treated  Water  Scenario. 

Public  Works,  Preventative  Medicine,  and  possibly  Security  personnel  must 
perform  spot  checks  of  water  system  assets  (e.g.,  treatment  plant  effluent,  individual  storage 
tanks,  distribution  system)  for  the  presence  of  TICs/TIMs  at  levels  that  could  cause  harmful 
health  effects  in  installation  populations. 

2.2. 1.4.2  Continuous  Flow  Sample  to  Test  Raw  or  Treated  Water  Scenario. 

Installation  Public  Works  personnel  must  monitor  continuously  for  the 
introduction  of  TICs/TIMs  into  the  base’s  water  supply  system  in  order  to  prevent  or  minimize 
problems. 

2.3  Technical  Requirements  Defined. 

The  user  representatives  developed  technical  requirements  for  the  six  scenarios 
(section  2.2.1).  These  requirements  define  in  detail  the  performance  specifications  for  each  ESB 
system  technology.  The  ESB  system  technical  requirements  are  made  up  of  26  technical 
requirement  questions  (covering  eight  evaluation  categories)  and  their  answers  (see  Appendix 
C).  The  purpose  of  this  requirements  document  is  to  provide  more  specific  information  for  the 
individual  scenarios  and  to  help  the  expert  panel  know  what  information  must  be  collected 
(though  research  or  additional  testing)  for  the  downselection  evaluation.  The  document  is  not 
intended  to  be  the  final  design  specification  for  an  ESB  system.  The  user  representatives  noted 
both  threshold/minimum  requirements  and  objective  (“give  me  everything  I  want”) 
requirements.  The  next  section  discusses  what  sensitivity  the  ESB  system  needs  to  identify 
toxicity  associated  with  industrial  chemicals. 
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Chose  and  Defined  Target  Detection  Range. 


The  range  the  ESB  system  technology  must  detect  TICs/TIMs  within  (upper  and 
lower  limit)  must  be  specified  before  the  technologies  can  be  evaluated. 

The  users  agreed  the  threshold  requirement  for  the  ESB  system  technologies  is  to 
detect  TICs/TIMs  between  the  short-term  Military  Exposure  Guidelines  (MEGs)  level  (standard 
for  a  soldier  drinking  15  liters/day  for  14  days,  see  Appendix  D  for  additional  information  about 
MEGs)  and  the  human  lethal  concentration  (HLC),  which  assumes  consumption  of  1 5  L  in  a  one 
day  period  by  a  70  kg  soldier.  The  ESB  project  will  not  focus  on  detecting  TICs/TIMs  at  more 
sensitive  levels  (e.g.,  long-term  MEG,  EPA  -  where  effects  are  chronic)  until  more  promising 
technology  becomes  available.  Until  then  operations  will  use  existing  analytical  chemistry  tools 
to  detect  TICs/TIMs  at  chronic  effect  levels. 

The  user  representatives  noted  that  sensors  should  detect  toxicity  closer  to  the 
short-term  MEG  level  than  the  HLC  level  and  that  the  minimum  detection  level  must  be  below 
the  HLC.  Finally,  user  representatives  stated  that  detecting  toxicity  below  the  short-term  MEG 
level  is  not  desirable  because  this  would  result  in  false  positive  readings. 

2.4  Candidate  ESB  System  Technologies  Identified  and  Partially  Described. 

After  extensive  research,  38  possible  ESB  system  technologies  were  identified 
(listed  in  Appendix  E)  for  further  research  and  evaluation.  Fact  sheets  were  created  for  each 
technology  (see  Appendix  F  for  an  example)  and  presented  to  all  expert  panel  members.  The 
information  within  the  fact  sheets  encompasses  performance,  operational,  and  logistical 
characteristics. 

2.5  Expert  Team  Determines  Additional  Testing  is  Needed. 

The  expert  team  determined  that  there  was  insufficient  toxicity  response 
information  for  a  thorough  comparative  evalution  of  the  ESB  system  technologies. 

2.6  Interim  Downselection  Process  Completed. 

The  six  scenarios  (section  2.2.1)  and  technical  requirements  (section  2.3)  are  the 
foundational  information  needed  to  develop  the  downselection  evaluation  model.  Because 
critical  data  about  the  technologies  were  not  available,  the  final  downselection  evaluation  model 
could  not  be  completed.  An  additional  step,  a  qualitative  evaluation,  was  added  to  the  process  to 
reduce  the  number  of  technologies  to  test  (based  on  what  could  be  funded)  to  generate  the  critical 
data. 

2.6.1  Overview  Description  of  Downselection  Evaluation  Model  Components  and  How 

Model  Is  Being  Developed. 

Evaluation  criteria  are  a  core  component  of  the  model.  The  criteria  are  comprised 
of  definitions,  performance  scales,  and  weights.  Criteria  are  quantitative  (e.g.,  response  time)  or 
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qualitative  (e.g.,  ease  of  use)  in  nature.  The  criteria  are  structured  as  a  hierarchical  model  and 
are  at  a  level  that  permits  discrimination  between  the  different  technologies.  Higher  level  criteria 
categories,  referred  to  as  goals,  include  factors  such  as  effectiveness/performance,  operational, 
logistics,  and  safety,  health,  and  environment.  Specific  sub-categories  of  criteria,  referred  to  as 
measures,  are  developed  to  provide  the  degree  of  discrimination  needed  for  the  technology 
evaluation.  Each  measure  has  an  associated  performance  scale  to  be  used  to  score  the 
technologies.  These  scales  are  expressed  in  natural  units  such  as  minutes,  or  are  constructed 
scales.  Utility  curves  are  developed  for  each  performance  scale.  The  final  step  in  model 
development  is  to  weight  the  criteria.  A  number  of  techniques  are  available  to  help  the 
evaluation  team  determine  the  relative  priorities  of  the  goals  and  measures. 

2.6.2  Development  To  Date  of  Downselection  Evaluation  Model. 

Significant  progress  was  made  in  developing  the  downselection  evaluation  model 
during  a  meeting  with  user  representatives  and  the  expert  panel  (see  Appendix  G).  The  final 
model  will  be  completed  after  the  required  data  for  ESB  system  technologies  is  generated. 

A  strawman  (initial  draft,  a  starting  point)  evaluation  model  was  developed 
initially  by  the  DAT.  The  model  was  then  reviewed  and  refined  by  the  evaluation  team  after  the 
scenario  development  (made  up  of  applications  and  use  concepts)  and  all  needed  data  for  the 
ESB  system  technologies  become  known.  The  user  representatives  have  primary  responsibility 
for  model  development;  however  the  technical  experts  provide  input  on  technical  feasibility. 
Although  the  goal  is  to  derive  one  evaluation  model  that  represents  all  requirements,  multiple 
models  may  be  needed  in  order  to  properly  evaluate  all  scenarios. 

2.6.3  Expert  Panel  Evaluated  Technologies  Using  a  High-Level  Qualitative  Model. 

As  stated  in  the  previous  section,  the  final  downselect  for  the  ESB  system 
technologies  could  not  be  done  without  additional  data.  Because  of  funding  and  time  constraints, 
it  was  not  possible  to  gather  the  needed  data  for  all  38  technologies.  A  high-level  qualitative 
model  was  created  to  choose  the  most  promising  ESB  system  technologies  to  take  into  the  lab  for 
further  testing. 


The  evaluation  method  used  a  two-step  process.  The  first  step  in  the  process  was 
to  determine  whether  a  technology  could  meet  all  threshold  requirements  of  the  Army  STO. 
Twenty-three  of  the  38  technologies  were  eliminated  by  this  step.  In  the  final  step  the  15 
remaining  technologies  were  evaluated  against  four  high  level  criteria  and  a  final  ranking  was 
generated.  The  criteria  were:  1)  sensitivity  response  and/or  provides  unique  information,  2) 
interferences,  3)  reliable/repeatable,  and  4)  rapidity  of  response  (see  Appendix  H  for  details  on 
the  evaluation  method  and  Appendix  I  for  the  results). 
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Expert  Panel  Chose  Nine  Technologies  for  Testing. 


The  following  ESB  system  technologies  were  determined  to  be  the  most 
promising  (1  is  most  promising,  14  least  promising)  by  the  expert  panel.  The  technologies  in 
bold  text  are  being  funded  for  additional  testing,  notes  are  provided  why  others  were  not  funded. 

1 .  Eclox  or  Aquanox  (expert  panel  only  wanted  to  test  one  of  these  technologies 
because  they  are  almost  the  same  in  performance  and  the  way  they  work  [i.e.,  mechanisms, 
modes  of  action],  with  additional  research  Eclox  was  determined  to  be  slightly  better  so 
Aquanox  was  dropped  from  further  consideration). 

2.  Microtox 

3.  Mitoscan 

4.  ToxScreen 

5.  Sinorhizobium  meliloti  Assay 

6.  SOS  Cytosensor 

7.  Portable  Neuronal  Microelectrode  Array 

8.  Portable  Cell-based  Biosensor  (owner  of  technology  unable  to  participate  in 
further  testing  at  this  time,  may  be  able  to  test  later  in  FY05). 

9.  Cellsense  (European-based  technology,  owner  of  technology  not  responsive 
to  request  to  participate  in  further  testing). 

10.  Amtox  (extremely  costly  to  test;  may  consider  testing  later  if  funding 
becomes  available). 

1 1.  Toxi-chromo  Test 

12.  Fluotox  (European-based  technology,  owner  of  technology  not  responsive  to 
request  to  participate  in  further  testing). 

13.  ArrayScan  HCS  System  (funding  not  available). 

14.  Epithelial  Cell  Toxicity  Sensor  (testing  is  provided  at  no  additional  cost). 
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2.7 


Selected  Training/Test  Chemical  Set,  Developed  Test  Plan,  and  Started  Testing 
Nine  Technologies. 


Prior  to  finalizing  a  test  plan  to  collect  the  data  for  the  nine  technologies,  the 
expert  panel,  with  input  from  the  Army  user  representatives,  identified  and  selected  a  set  of 
training/test  chemicals.  These  chemicals  are  being  used  to  form  a  common  basis  for  comparison 
of  test  results  for  the  nine  ESB  systems  technologies  that  are  being  further  tested  and  will  used  to 
generate  new  toxicity  data.  Twelve  chemicals  were  selected  by  the  expert  panel  to  be  the 
training/test  chemical  set  (see  Appendix  J  for  a  more  detailed  discussion  on  the  selection  of  test 
chemicals  and  the  list  of  chemicals). 

To  acquire  toxicity  response  data,  an  experimental  design  and  analysis  plan  was 
developed  (see  Appendix  K  for  additional  information  on  the  test  plan)  and  a  contract  was  issued 
to  Battelle  Memorial  Institute  in  late  FY04  to  collect  this  data.  A  statistician  provided  peer 
review  of  the  experimental  design.  Testing  should  be  completed  during  the  2nd  quarter  of  FY05. 


3.  FY05  PLANS  TO  COMPLETE  THE  ENVIRONMENTAL  SENTINEL 

BIOMONITOR  (ESB)  SYSTEM  TECHNOLOGY  DOWNSELECTION 
PROCESS. 

In  FY04  the  groundwork  for  a  successful  downselection  in  FY05  was  completed. 
By  collecting  the  detailed  data  needed  for  each  of  the  nine  ESB  system  technologies  early  in 
FY05  it  should  be  possible  to  complete  the  downselect  before  mid-year.  The  final  steps  in  the 
downselection  process  are  described  next. 

3.1  Complete  Data  Collection  for  Nine  “Finalist”  Technologies. 

The  testing  that  started  in  FY04  should  be  completed  by  the  middle  of  the  2nd 
quarter  in  FY05.  The  testing  process  is  being  managed  through  a  contract  with  Battelle 
Memorial  Institute. 

3.2  Complete  Evaluation  Model. 

After  the  test  data  becomes  available,  the  DAT  will  refine  the  initial 
downselection  evaluation  model  and  present  it  to  the  user  representatives  and  expert  panel.  The 
team  will  then  finalize  the  model  jointly  at  a  meeting. 

3.3  Evaluate  Nine  Technologies. 

The  expert  panel  will  complete  the  downselect  evaluation  by  assessing  each 
technology  against  each  criterion  in  the  evaluation  model(s).  For  this  meeting,  primary  input 
will  come  from  the  technical  experts.  The  assessment  process  will  be  facilitated  by  the  DAT, 
and  final  scoring  will  be  based  on  group  consensus.  This  step  should  be  complete  by  the  end  of 
the  2nd  quarter  in  FY05. 
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3.4 


Complete  Analysis  and  Produce  Final  Report. 


The  analysis  will  be  performed  after  the  nine  ESB  system  technologies  are 
evaluated  using  the  downselect  evaluation  model.  The  DAT  will  analyze  the  information 
generated  during  the  technology  assessment  phase  as  described  below. 

First,  an  overall  score  for  each  technology  will  be  generated  based  on  individual 
criterion  scores  and  the  weight  given  to  each  criterion.  Detailed  analysis  will  be  conducted  to 
summarize  why  the  technologies  scored  as  they  did,  to  include  identifying  significant  strengths 
and  weaknesses  for  each  technology  relative  to  the  criteria.  This  will  be  important  in 
determining  whether  there  are  synergies  between  the  technologies  (it  is  unlikely  one  technology 
will  satisfy  all  requirements).  It  will  also  allow  researchers  and/or  users  to  choose  the 
technology  that  best  fits  their  needs  (it’s  possible  the  technology  with  the  highest  overall  ranking 
may  not  be  the  ideal  technology  to  use  for  a  particular  user  because  of  their  unique  needs). 
Analysis  will  also  be  conducted  to  identify  areas  of  technical  challenge  to  help  focus  future 
research  and  development  efforts.  Finally,  sensitivity  analysis  will  be  performed  to  determine 
the  impact  of  model  variations  (e.g.,  alternative  weighting  schemes  or  scoring  uncertainties)  on 
the  results. 


The  DAT  will  produce  a  final  report  similar  in  scope  and  detail  to  this  initial 
report  that  incorporates  the  work  completed  in  FY05. 
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APPENDIX  A 


ENVIRONMENTAL  SENTINEL  BIOMONITOR  (ESB)  SYSTEM: 

INITIAL  TECHNOLOGY  DOWNSLECTION  PLAN 

I.  Introduction.  Deployed  US  forces  face  the  possibility  of  drinking  water  exposures  to  a  wide 
range  of  toxic  industrial  or  agricultural  chemicals  as  a  result  of  damaged  infrastructures, 
accidental  spills,  or  deliberate  chemical  contamination  of  water.  Unfortunately,  rapid  detection 
capabilities  for  toxic  chemicals  in  water  are  limited  and  may  not  provide  sufficient  warning  of 
developing  toxic  hazards.  The  U.S.  Army  Center  for  Environmental  Health  Research 
(USACEHR)  is  developing  an  ESB  system  to  complement  chemical  monitoring  systems  and 
provide  rapid  toxicity  identification  for  a  broad  spectrum  of  chemicals  in  water. 

ESB  systems  monitor  responses  of  biological  components  (i.e.,  cells,  tissues,  or  whole 
organisms)  exposed  to  water  and  to  provide  rapid  responses  should  toxic  conditions  develop. 
Cell-  and  tissue-based  sensors  are  becoming  available  that  integrate  biological  systems  with 
electronic  monitoring,  facilitating  rapid  response  to  developing  toxicity  in  water  using  very  small 
systems.  With  support  from  Army  client  organizations  and  funding  from  a  new  Army  Science 
and  Technology  Objective  (STO),  USACEHR  will  incorporate  these  toxicity  sensors  into  an 
ESB  system  having  size,  weight,  and  logistical  requirements  suitable  for  deployment.  This  paper 
provides  an  overview  of  the  toxicity  sensor  downselection  process  and  identifies  associated 
technical  issues. 

II.  ESB  Technology  Downselection.  A  critical  initial  phase  of  the  STO  is  to  test  and  evaluate 
toxicity  sensors.  Because  there  are  a  number  of  potentially  feasible  technologies  that  could  meet 
the  goal  of  the  ESB  program,  a  downselect  will  be  performed  to  evaluate  these  technologies  and 
select  the  most  promising  technologies  for  test  and  evaluation.  The  downselect  will  employ  a 
logical,  structured  decision  analysis  process,  and  the  results  and  rationale  will  be  documented  so 
that  final  recommendations  can  be  explained  and  defended.  This  downselect  process  will  be 
comprised  of  several  distinct  parts/phases,  as  described  below. 

A.  Select  study/evaluation  team.  An  evaluation  team  will  be  formed  to  conduct  the 
downselect.  The  team  will  be  led  by  Dr.  William  van  der  Schalie  (USACEHR)  and  Dr.  Thomas 
Gargan  II  (GEO-CENTERS,  Inc.),  with  support  from  the  Decision  Analysis  Team  (DAT)  of  the 
Edgewood  Chemical  and  Biological  Center.  The  evaluation  team  will  be  made  up  of  Army  user 
representatives  (members  of  an  Integrated  Product  Team  -  IPT)  and  technical  experts  from 
collateral  organizations  and  academia. 

B.  Determine  use  concepts/applications.  Army  applications  for  an  ESB  system  have  been 
identified  as  part  of  the  STO  program  definition.  Examples  include: 

•  Use  in  conjunction  with  the  Tactical  Water  Purification  System  (TWPS),  including 
evaluation  of  water  pre-  and  post-treatment  and  supporting  decisions  regarding  the 
suitability  of  using  a  freshwater  bypass  system.  The  ESB  system  is  consistent  with 
a  recommendation  in  the  Pre-Planned  Product  Improvement  section  of  the  TWPS 
Operational  Requirements  Document. 


A-l 


•  Testing  water  produced  by  on-board  water  generation  equipment  in  manned  ground 
vehicles  being  developed  under  the  Future  Combat  Systems  (FCS)  program. 

•  Use  by  Preventive  Medicine  personnel  to  evaluate  potable  water  quality  in  a  variety  of 
situations. 

•  Use  at  Army  installations,  both  domestically  and  overseas,  to  evaluate  source  and 
drinking  water  quality. 


IPT  members  will  be  responsible  for  identifying  applications  for  the  ESB  system  and  defining  in 
detail  how  the  system  might  be  used  (Conditions  of  Operation  -  CONOPS).  This  information 
will  be  important  to  help  define  desired  system  characteristics. 


C.  Identify  and  describe  candidate  technologies.  Toxicity  sensor  technologies  that  have 
potential  to  meet  ESB  program  needs  will  be  identified  and  described.  The  information  that  will 
be  described  encompasses  performance,  operational,  and  logistical  characteristics.  The 
technology  information  will  be  documented  in  a  fact  sheet  format.  This  information  will  be 
provided  to  the  study  team  participants  prior  to  evaluation  model  development,  so  everyone  has 
an  understanding  of  the  range  of  technologies  that  will  be  evaluated. 

D.  Develop  evaluation  model  (criteria,  definitions,  performance  scales,  weights).  The 
applications,  CONOPS,  and  requirements  will  be  used  as  the  foundation  to  derive  evaluation 
criteria  for  the  downselect.  The  criteria  will  be  comprised  of  definitions,  performance  scales, 
and  weights.  Criteria  can  be  quantitative  (e.g.,  response  time)  or  qualitative  (e.g.,  ease  of  use)  in 
nature.  The  criteria  will  be  structured  as  a  hierarchical  model  and  will  be  at  a  level  that  will 
permit  discrimination  between  the  different  technologies.  Higher  level  criteria  categories, 
referred  to  as  goals,  include  factors  such  as  effectiveness/performance,  operational,  logistics,  and 
safety,  health,  and  environment.  Specific  sub-categories  of  criteria,  referred  to  as  measures,  will 
be  developed  to  provide  the  degree  of  discrimination  needed  for  the  technology  evaluation.  Each 
measure  will  have  an  associated  performance  scale  to  be  used  to  score  the  technologies.  These 
scales  can  be  expressed  in  natural  units  such  as  time,  or  may  be  constructed  scales.  Utility 
curves  will  also  be  developed  for  each  performance  scale.  The  final  step  in  model  development 
will  be  to  weight  the  criteria.  A  number  of  techniques  are  available  to  help  the  evaluation  team 
determine  the  relative  priorities  of  the  goals  and  measures. 

A  strawman  evaluation  model  will  be  developed  initially.  This  model  will  be  reviewed  and 
refined  by  the  evaluation  team  during  the  initial  evaluation  team  meeting  after  the  use  concepts 
are  developed.  Again,  the  IPT  will  have  primary  responsibility  for  model  development,  although 
the  technical  experts  will  provide  input  on  technical  feasibility. 

Although  the  goal  is  to  derive  one  evaluation  model  that  represents  all  requirements,  multiple 
models  may  be  needed  in  order  to  properly  evaluate  all  scenarios. 


E.  Evaluate  technologies.  The  evaluation  team  will  convene  to  assess  the  technologies  against 
the  evaluation  model(s).  For  this  meeting,  primary  input  will  come  from  the 
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technical  experts.  The  assessment  process  will  be  facilitated  by  the  DAT,  and  final  scoring  will 
be  based  on  group  consensus. 

F.  Perform  analysis  and  report  results.  The  DAT  will  analyze  the  information  generated 
during  the  technology  assessment  phase.  Logical  Decisions  for  Windows  (LDW),  a  decision 
analysis  software  tool,  will  be  used  to  support  the  analysis. 

The  analysis  phase  will  consist  of  a  number  of  steps.  First,  an  overall  score  for  each  technology 
will  be  generated  based  on  individual  criterion  scores  and  the  weight  given  to  each  criterion. 
Detailed  analysis  will  be  conducted  to  summarize  why  the  technologies  scored  as  they  did,  to 
include  identifying  significant  strengths  and  weaknesses  for  each  technology  relative  to  the 
criteria.  This  will  be  important  in  determining  whether  there  are  synergies  between  the 
technologies  (it  is  unlikely  one  technology  will  satisfy  all  requirements).  It  will  also  allow 
researchers  and/or  users  to  choose  the  technology  that  best  fits  their  needs  (it’s  possible  the 
technology  with  the  highest  overall  ranking  may  not  be  the  ideal  technology  to  use  for  a 
particular  user  because  of  their  unique  needs).  Analysis  will  also  be  conducted  to  identify  areas 
of  technical  challenge  to  help  focus  future  research  and  development  efforts.  Finally,  sensitivity 
analysis  will  be  performed  to  determine  the  impact  of  model  variations  (e.g.,  alternative 
weighting  schemes  or  scoring  uncertainties)  on  the  results. 

A  report  of  the  study  will  be  prepared  by  the  DAT. 

III.  ESB  Downselection  Issues.  There  are  a  number  of  key  issues  relevant  to  toxicity  sensor 
selection  and  evaluation.  It  is  hoped  that  this  paper  will  stimulate  discussion  that  will  help 
further  define  the  developmental  process  for  the  ESB  system.  Key  questions  include: 

•  What  toxicity  benchmarks  should  be  used  to  evaluate  toxicity  sensor  responses  to 
chemicals? 

•  What  kind  of  (and  how  many)  test  chemicals  should  be  used  to  evaluate  toxicity 
sensor  performance? 

•  How  should  toxicity  sensor  performance  be  evaluated? 

•  Can  chemical  monitoring  technologies  be  leveraged  with  the  ESB  system  operation? 

A.  Toxicity  benchmarks.  To  select  an  appropriate  toxicity  benchmark  for  evaluating  ESB 
toxicity  sensors,  the  toxicity  target  must  first  be  specified.  As  defined  in  the  original  STO 
proposal,  the  desired  STO  product  is  a  system  that  will  “...  provide  rapid  identification  of  acute 
toxic  hazards  in  water”.  The  goal  is  to  quickly  respond  to  toxic  exposures  that  could  affect  a 
soldier’s  health  and  performance  in  the  field. 

One  possible  frame  of  reference  for  evaluating  toxicity  sensor  performance  is  provided  by  the 
Military  Exposure  Guidelines  (MEGs;  USACHPPM,  2001).  MEGs  are  provided  for 
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water  (and  other  media)  to  estimate  a  level  above  which  certain  types  of  health  effects  may 
begin  to  occur  in  individuals  amongst  the  exposed  population”.  MEGs  are  designed  to 
indicate  ‘thresholds’  for  minimal  to  no  adverse  health  effects”  and  are  considered  "...  protective 
against  any  significant  non-cancer  effects”.  MEG  exposure  scenarios  for  water  are  appropriate 
for  a  deployed  military  operation,  i.e.,  exposure  lasting  either  5  or  14  days,  with  water 
consumption  of  either  5  or  15  L/day.  The  exposed  population  is  defined  to  include  "...  relatively 
healthy  and  fit  male  and  non-pregnant  female  adults”,  18  to  55  years  old  with  and  average 
weight  of  70  kg.  It  is  important  to  note  that  while  MEGs  are  not  enforceable  military  standards, 
the  MEGs  are  considered  guideline  concentrations  for  identifying  and  ranking  Occupational  and 
Environmental  Health  (OEH)  risks.  MEGs  have  been  established  for  about  170  chemicals.  The 
National  Research  Council’s  Board  on  Environmental  Studies  and  Toxicology  is  conducting  a 
review  of  the  MEGs  in  a  project  entitled  “Review  of  the  Army's  Technical  Guidance  Documents 
on  Assessing  Toxicological  Risks  from  Exposures  to  Chemicals”;  a  report  is  currently  in 
preparation. 

MEGs  provide  a  reference  point  above  which  adverse  effects  may  be  expected  after  a  field¬ 
relevant  period  of  exposure  and  may  serve  as  lower  thresholds  for  toxicity  sensor  responses. 

That  is,  responses  at  concentrations  below  the  MEGs  indicate  toxic  effects  that  may  not  be 
relevant  to  acute  human  health  impairments. 

What  then  should  be  an  upper  threshold  for  toxicity  sensor  responses?  One  possibility  is  the 
human  oral  lethal  dose,  which  has  been  compiled  for  a  number  of  chemicals  by  the  Multicenter 
Evaluation  of  In  Vitro  Cytotoxicity  (MEIC)  program.  The  MEIC  program  evaluated  the  use  of 
67  in  vitro  cytotoxicity  tests  for  predicting  acute  systemic  toxicity  in  humans  for  a  set  of  50  test 
chemicals  representing  a  wide  range  of  modes  of  toxic  action  (Clemedson  et  al.,  1998;  Ekwall  et 
al.,  2000).  The  MEIC  analysis  evaluated  the  relationship  between  cytotoxicity  assay  results  and 
human  lethal  blood  concentrations  and  the  ability  of  rodent  LD50S  to  predict  human  oral  lethal 
doses.  Although  cytotoxicity  assay  results  are  logically  compared  with  lethal  blood 
concentrations  rather  than  lethal  dose  (i.e.,  without  adding  the  compounding  factors  of 
intervening  uptake,  metabolism,  and  depuration),  ESB  toxicity  sensors  must  evaluate  drinking 
water  suitability  directly  based  on  evaluation  of  the  water  to  which  the  sensors  are  exposed. 

Thus,  for  the  ESB  project,  human  oral  lethal  doses  may  be  a  more  appropriate  measure  of  the 
upper  response  level  for  a  toxicity  sensor  than  human  lethal  blood  concentrations. 

Figure  1  illustrates  one  possible  approach  for  evaluating  the  suitability  of  a  toxicity  sensor  for 
identifying  the  presence  of  toxic  chemicals  in  drinking  water.  Shown  is  the  relationship  between 
MEGs,  corresponding  human  lethal  doses,  and  responses  of  one  human  cell  cytotoxicity  assay 
(Chang  liver  cell)  for  the  14  chemicals  having  both  MEGs  and  MEIC  study  data.  The  chemicals 
are  arranged  in  order  of  increasing  human  lethal  dose.  For  most  chemicals,  there  is  a  two  to  four 
log  difference  between  the  MEG  and  the  corresponding  human  lethal  dose.  A  notable  exception 
is  cyanide,  for  which  the  difference  is  a  factor  much  less  than  one  log.  Only  six  of  the  14  IC50S 
(concentrations  causing  a  change  in  morphology  in  50%  of  exposed  cells)  fall  between  the  acute 
lethal  human  value  and  the  corresponding  MEG  (Figure  1).  However,  if  technology  were 
available  to 
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concentrate  a  chemical  within  a  water  sample  the  relationship  between  the  chemical  IC50  value 
and  its  corresponding  lethal  human  value  and  MEG  would  change  dramatically  (Figure  2).  In 
this  case,  a  factor  of  10  concentration  of  a  tested  water  sample  containing  the  chemicals  would 
put  the  IC50S  for  all  but  one  chemical  (cyanide)  within  the  MEG-acute  lethal  range  (Figure  2). 


1  2  3  4  5  6  7  8  9  10  11  12  13  14 

Chemical  number 


1 

Arsenic  trioxide 

2 

Thallium  sulfate 

3 

Potassium  cyanide 

4 

Pentachlorophenol 

5 

Paraquat 

6 

Lindane 

7 

Phenol 

8 

Malathion 

9 

Chloroform 

10 

Carbon  tetrachloride 

11 

Xylene 

12 

Dichloromethane 

13 

Ethylene  glycol 

14 

Trichloroethane,  1,1,1- 

Figure  1.  Human  cell  line  (Chang  liver  cells)  24-h  IC50S  for  14  chemicals  (Clemedson  et  al., 
1996)  compared  with  corresponding  acute  human  lethal  concentrations  (Ekwall  et  al.,  1998)  and 
Military  Exposure  Guideline  (MEG)  levels  (USACHPPM,  2001).  One  day  of  exposure  to  a  14- 
day  MEG  was  converted  to  dose  assuming  5  L/day  water  consumption  by  a  70  kg  adult. 
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1 

Arsenic  trioxide 

2 

Thallium  sulfate 

3 

Potassium  cyanide 

4 

Pentachl  oropbenol 

5 

Paraquat 

6 

Lindane 

7 

Phenol 

8 

Malathion 

9 

Chloroform 

10 

Carbon  tetrachloride 

11 

Xylene 

12 

Dichloromethane 

13 

Ethylene  glycol 

14 

Trichloroethane,  1,1,1- 

Figure  2.  Effect  of  a  hypothetical  ten-fold  concentration  of  water  samples  on  Figure  1  IC50  data. 
Human  cell  line  (Chang  liver  cells)  24-h  IC50S  (divided  by  10)  for  14  chemicals  (Clemedson  et 
al.,  1996)  compared  with  corresponding  acute  human  lethal  concentrations  (Ekwall  et  al.,  1998) 
and  Military  Exposure  Guideline  (MEG)  levels  (USACHPPM,  2001).  One  day  of  exposure  to  a 
14-day  MEG  was  converted  to  dose  assuming  5  L/day  water  consumption  by  a  70  kg  adult. 


B.  Selection  of  test  chemicals.  Considering  the  thousands  of  toxic  industrial  and  agro¬ 
chemicals,  an  appropriate  evaluation  of  toxicity  sensor  performance  requires  careful  initial 
selection  of  the  chemicals  to  be  evaluated.  Some  possible  criteria  for  selecting  test  chemicals 
include: 


•  Threat  chemicals.  Several  organizations  (U.S.  Environmental  Protection  Agency 
(EPA),  U.S.  Army  Research  Development  and  Engineering  Center  (ARDEC))  and  publications 
(Garland,  1991 ;  Hickman,  1999;  Clark  and  Deininger,  2000)  have  developed  lists  of  threat 
chemicals  for  water  supplies.  Typically,  the  higher  priority  chemicals  are  highly  toxic,  soluble, 
persistent  in  water,  and  available  in  the  region  of  concern.  Chemicals  high  on  these  lists  should 
be  given  priority  as  test  chemicals  for  toxicity  sensors. 

•  Mode  of  toxic  action.  Some  chemicals  can  be  grouped  together  because  they  cause 
similar  effects  on  organisms.  Examples  include  organophosphorus  and  carbamate  insecticides 
(which  cause  acetylcholinesterase  inhibition)  and  many  neutral  organic  chemicals  such  as 
industrial  solvents  (which  cause  narcosis).  To  the  extent  that  chemicals  can  be  grouped  in  this 
way,  it  should  be  possible  to  select  one  or  two  representative  chemicals  from  the  group  for 
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testing  to  establish  whether  a  toxicity  sensor  will  respond  to  chemicals  exhibiting  the  same 
general  mode  of  toxic  action. 

•  Chemical  structural  classes.  Chemicals  with  certain  structural,  functional,  or 
other  similarities  are  frequently  grouped  together  for  testing  purposes,  such  as  heavy  metals, 
algal  toxins,  or  herbicides.  Since  chemicals  within  these  groups  may  have  distinctly  different 
modes  of  toxic  action,  it  is  best  to  emphasize  mode  of  toxic  action  categories  in  the  selection  of 
test  chemicals.  The  MEIC  chemical  list  provides  a  broad  range  of  both  modes  of  toxic  action 
and  chemical  structural  classes  (Clemedson  etal.,  1996,  1998). 

•  Interfering  chemicals  or  water  quality  conditions.  Interfering  chemicals 
include  substances  commonly  found  in  raw  or  treated  water  that  may  cause  toxicity  sensor 
responses  at  levels  far  below  concentrations  affecting  humans,  such  as  residual  chlorine,  copper, 
or  ammonia.  In  addition,  acceptable  ranges  of  common  water  quality  conditions,  such  as 
temperature,  dissolved  oxygen,  conductivity,  pH,  turbidity,  and  microbial  concentrations  need  to 
be  defined  for  toxicity  sensors  to  help  minimize  “false  positive”  responses. 

Given  the  broad  range  of  potential  test  substances,  a  compromise  must  be  reached  between 
minimizing  the  number  of  chemicals  to  conserve  resources  and  expanding  the  number  to  better 
define  toxicity  sensor  response  characteristics.  One  possible  solution  is  the  use  of  a  tiered 
approach  -  conduct  an  initial  screening  of  several  toxicity  sensor  technologies  with  a  few 
chemicals,  followed  by  more  thorough  evaluation  of  technologies  showing  the  most  promise. 
Consideration  should  be  given  to  identifying  a  complementary  set  of  toxicity  sensors  with  regard 
to: 


•  Rapid  response.  A  very  rapid  (e.g.,  response  in  a  few  minutes)  evaluation 
with  an  inexpensive  test  that  may  be  prone  to  false  positives  could  be  followed  by  a  more 
reliable  but  slower  (e.g.,  response  in  an  hour)  toxicity  test  for  confirmation. 

•  Sensitivity.  One  toxicity  sensor  type  may  not  adequately  cover  all  chemicals. 
Sensor  evaluation  should  consider  not  only  which  toxicity  sensor  provides  the  best  overall 
response  to  the  test  chemicals,  but  which  set  of  sensors  can  complement  each  other  by  filling 
gaps  in  toxicity  response  for  individual  sensors  as  well  as  providing  mutual  confirmation  of  a 
toxic  response. 

C.  Defining  toxicity  sensor  performance.  When  it  is  time  to  evaluate  the  response 
characteristics  of  a  toxicity  sensor  to  selected  test  chemicals,  the  issue  of  defining  a  response 
threshold  (=  cutoff  point)  must  be  addressed.  Receiver  Operator  Characteristic  (ROC)  curves,  a 
type  of  statistical  decision  theory  that  have  recently  become  a  very  useful  tool  in  medical- 
decision  making.  A  web-based  ROC  curve  tutorial  is  available 

(http://www.anaesthetist.com/mnm/stats/roc/  (Click  the  Refresh  button  if  the  page  does  not 
immediately  open). 


ROC  curves  are  a  graphic  method  of  showing  the  true  positive  rate  (sensitivity)  and  the  false 
positive  rate  (1 -specificity)  at  each  possible  cutoff  point  (=  threshold)  of  the  test  results.  The 
major  advantage  of  ROC  curve  analysis  is  in  defining  the  “cutoff’  between  “positive”  and 
“negative”  values.  ROC  curves  are  useful  in  accessing  the  discriminatory  power  of  diagnostic 
tests  and  evaluating  sensor  performance  in  a  broad  range  of  fields.  The  following  URLs  show 
some  recent  uses  of  ROC  curve  analysis  to  evaluate  sediment  quality  guidelines  for  metals 
(http://www.hsph.harvard.edu/shinelab/ROCpresentation.pdf)  and  beach  water  quality  indicator 
variables  (http://aem.asm.Org/cgi/reprint/69/I  l/6405.pdf). 

The  ESB  system  may  utilize  various  types  of  ROC  curve  analysis,  namely,  in  the  diagnostic 
accuracy  of  a  toxicity  sensor  to  identify  a  toxicant  at  various  concentrations,  comparing  tests 
repeated  on  different  occasions,  and  comparing  ability  of  different  toxicity  sensors  to  detect  a 
toxicant.  The  ESB  program  is  planning  on  using  a  statistician  to  help  in  the  experimental  design 
and  the  analysis  of  the  toxicity  sensor  performance. 

D.  Technology  leveraging.  ESB  system  development  must  be  integrated  with  other  Army-  and 
DoD-related  research  and  development  activities  for  water  analysis.  As  a  matter  of  principle, 
ESB  system  platform  development  should  leverage  work  that  has  already  been  performed  on  the 
Joint  Service  Agent  Water  Monitor  (JSAWM),  particularly  in  the  areas  of  sample  preparation 
and  delivery,  sensor  platform  configuration,  and  data  analysis  and  display.  Where  possible, 
similar  designs  and  approaches  should  be  employed  so  that  the  ESB  system  and  the  JSAWM  are 
compatible.  While  ESB  system  development  is  focused  on  toxicity  sensors,  the  availability  of 
simple,  rapid  screening  technologies  for  a  wide  range  of  toxic  industrial  materials  should  be 
tracked  and  incorporated  in  the  ESB  approach  where  possible  to  provide  confirmatory  evidence 
of  a  chemical  etiology  for  a  toxicity  sensor  response.  Similarly,  although  pathogen  identification 
is  not  an  objective  of  the  ESB  STO,  possible  dual  use  technologies  for  chemical  toxicity  and 
pathogen  identification  should  be  considered.  One  example  is  the  “CANARY  cells”  (Cellular 
Analysis  and  Notification  of  Antigen  Risks  and  Yields;  Rider  et  al. ,  2003),  which  are 
mammalian  lymphocytes  specifically  designed  for  pathogen  identification  but  which  might  have 
application  for  toxicity  identification  as  well. 
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V.  Acronyms 


ARDEC  Army  Research  Development  and  Engineering  Center 

CANARY  Cellular  Analysis  and  Notification  of  Antigen  Risks  and  Yields 

CONOPS  Conditions  of  Operation 

DAT  Decision  Analysis  Team 

DoD  Department  of  Defense 

EPA  US  Environmental  Protection  Agency 

ESB  Environmental  Sentinel  Biomonitor 

FCS  Future  Combat  Systems 

IC  Inhibitory  Concentration 

IPT  Integrated  Product  Team 

JSAWM  Joint  Service  Agent  Water  Monitor 

LD  Lethal  dose 

LDW  Logical  Decisions  for  Windows 

MEG  Military  Exposure  Guidelines 

MEIC  Multicenter  Evaluation  of  In  Vitro  Cytotoxicity 

OEH  Occupational  and  Environmental  Health 

ROC  Receiver  Operator  Characteristic 

STO  Science  and  Technology  Objective 

TWPS  Tactical  Water  Purification  System 

US  United  States 


USACEHR  United  States  Army  Center  for  Environment  Health  Research 
USACHPPM  United  States  Army  Center  for  Health  Promotion  and  Preventive  Medicine 
URL  Universal  Resource  Locator 
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APPENDIX  B 


ENVIRONMENTAL  SENTINEL  BIOMONITOR  (ESB)  SYSTEM 
DOWN  SELECTION  PROJECT  TEAM 


First  name 

Last  Name 

Affiliation 

Ric 

De  Leon 

Metropolitan  Water  District  of  Southern  California 

Jay 

Dusenbury 

US  Army  Research,  Development  and  Engineering 
Command 

Tom 

Gargan 

U.S.  Army  Center  for  Environmental  Health  Research 

Mike 

Goode 

Edgewood  Chemical  Biological  Center 

John 

Harbell 

Institute  for  In  Vitro  Sciences 

Wally 

Hayes 

Harvard  School  of  Public  Health 

Janet 

Jensen 

Edgewood  Chemical  Biological  Center 

Scott 

Kooistra 

Edgewood  Chemical  Biological  Center 

Joe 

Pancrazio 

National  Institutes  of  Health  (Neurological  Disorders 
and  Stroke) 

Steve 

Richards 

U.S.  Army  Center  for  Health  Promotion  and 

Preventive  Medicine 

Robert 

Ryczak 

U.S.  Army  Center  for  Health  Promotion  and 

Preventive  Medicine 

Stanley 

States 

Pittsburgh  Water  &  Sewer  Authority 

Roy 

Thompson 

Edgewood  Chemical  Biological  Center 

Bill 

Van  der  Schalie 

U.S.  Army  Center  for  Environmental  Health  Research 

Jeremy 

Walker 

US  Army  Research,  Development  and  Engineering 
Command 

John 

Walther 

Edgewood  Chemical  Biological  Center 

Mike 

Wright 

Boeing,  Inc.  (Representative  for  Lead  System 

Integrator,  Future  Combat  Systems  -  Manned  Ground 
Vehicle  program) 
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_ _ _ _ _ APPENDIX  C _ _ 

ENVIRONMENTAL  SENTINEL  BIOMONITOR  (ESB)  SYSTEM  TECHNICAL  REQUIREMENTS  FOR  USER  SCENARIOS 

_ _ Notes.  T  means  threshold  or  minimum  requirement;  "O"  means  objective  or  maximum  requirement  (Ol  is  a  higher  priority  than  02) 

Category _ Tech.  Requirements  Scenarios  " - 


£  g 


•a 

o  £ 


--j  E 

5  P3 

3  H 


a;  cj 

t- 

H 


U 


o 

<n  CJ 

P° 


•s  X 
2  & 

OJ  „© 

££■... 
-  O  ' 


S  Si 

r  .  TO  g 

m  o  o  ^ 
m  £  v)  is 

Aiayp. 


u  , 


U  H 


e  O 

O  <n 


Iri^ 
I*  lT  ^ 

—  Q£ 


o  o 

o  o 


o  t& 
55 


)  CJ  U 

>  O'.  f'J 


2  o' 


~  o 
[u  X 

N  o  ^ 

•  (N 


*2  y 
o 


*  f— 


.  u 


<§■; 


-  o 


fe  o 

re  vty 

-  -3- 


4>  re  re- 
U  ^  c  O 
On  2  T? 

O  *  U 

55  m  2 


y 


ro  k  ~ 


t*  ° 


w  X 
2 

Ouo® 

°  g 


fc  O  ,,  - 


o 

VD 

x  O  U  C 

^  <N  o  w 

So" 


J,  2  2  — 

-  ri  o  , ,  2ro 

ct_0njjOx>o 

.1  --si^o0 

ts  C  •  -  <d  rah- 

2“.2po  o  c 

sc  -  L  os  2  “■ 

rl  V,  GO 


CL  l/’' 

C  ^ 


'  o  J  U 

«  S  2 

Vi 


TO  CJ 
c  r  j 
C  re) 


an  r 
re 

o 

0r> 


■2°So 

2  C)  Tt  ^ 

C  o  U 
>  *•*  On 

:  u  ** 

3  o  o 


§ 


cj  O 
00  — 
2  O 
o  — 

to 

o  5 

<n  r ) 
'So 
u 

o 


O  CJ 

“  & 


o  -o 
o  o 

o  pp 


2  _re  cj 

o.  2  6 
J=  3  T 
5  £  & 
2  2 
'5  c-'p 
S  -S*  2 


at  E 


«  w 

y:  w  ^ 

|  JP 

Iff 

L-  £  u. 

'isa 

w 


oj  >  o  i 
o  — <  •*-  E 
O- 


g  'C  5.0, 


^  ^  -8  22  j? 

Tt  cl  >>:=  o  .*2 
o  x:  o  o  £  x) 

s? 


E  - 

o.  , 

Cl  t 


'  £ 
'  £ 


a>  >/~) 


c  c 


o  c 

1'  =  is  1  b  I 
'■3-g-g  S  “P 
o  6  b 
8  “  ■§  2  m  I  te 

»  p  ^  |  3  B  £ 

O-  W  U  K  Q. 

^  £  E  2i  a 
x> 


^  o  ^  ?: 

C  o  >  O  ^  £ 

y  7s  r  «  E 


O  Cl 


aO 


S  *2  re*  X3  -=  *p  Ci  re 
*  ■  ■”*  e/>  -  —  r,1 
b3  ^  xj 


a  > 


re 


—  O  T3  .  ^ 

.  x:  c  o  £  ^  u  ^ 

!S  2  w  —  "• 


CO 


5  re  ^  t-* 


c  =  -o  >  Jbx  ; 
cS  £  re  'C  c  -r  ‘ 

i .  .  "<x  x:  c  b—  S-  . — . 

O  s  .2  r -g  ao 

«  b  ^  t-  Ci  w 
y  O  2  S  O  c 
c  >  S3  u  I?  c 

CJ  *re  c~i  tp  dj  3  0« 

tc,  O  •*-'  bX  p.  ^  cl 

o  WJ  O  9  re  35 


&  X 


CJ 


o  *£ 


CJ 


o 


^  c  £  cr 

SiSfEggS? 

C  O  a  re  c*  re 

O  cn  r  j-.SpN  C 
Cr,  oo  -*00  cj  — ■  cl 

tti  ^.1  ®  i  ^  2 

sf I S^1 I I si 


2  £• 
1  cl  *6 
3  X 


o 
oj 

C  aj  x 


2-g 

re 


o)  b  a  f5 

t/5  Oh  I? 

2  ^  T3 
*  cj 


CJ 


cn 


t/i  x.  •  — 

cj  o  re 

L-  C/i  cj  -3 
CL  trt  re 

*5  J5 


•gt 
=  s  ■ 

2  cl  : 

CJ  CL  ’ 


\c:  oo 
.52  ci 


CJ 


2  c 
re  re 
x  x 
cj  ^ 

l_  u>  , 

<u  O  • 
re  B 
^  o  . 

lh  x» 
cj  ’> 
-£  cj 


X  T 
O  O 

(A  -~2 

v.  X 

•-5  2  . 

*re  i^1  * 


5=  •  S  t- 

re  --  00 

o  3  C 
3  o  S 
c  o  a 
ID 


°  u 

CL  o 

B  "9 


D.O  b 


iio 

O  -A. 

T  H 

Tf  W 

o 

H  on  w 

O'  o 
«n  — 

•■  P- 
X  2 

Cl  «> 

H 


,  u 
?  O 

o 


•n  f_ 


3,6 


_a>  o 

P 


o  U 
TJO 

h--<=  U 

b  iLg 
o,  E'? 

I  CJ  o 

“T:  ^ 

e  ^b 


o  O  _ 

TJO 
~t  ty  s 

U 

t  do 
»  E1? 

P  P  °. 

ipfc 
p.  Q 


O  o 


A  o 

O  °  b 
H  ^  O 
r"  o  o 

On  no 

iA  £- 

X  S 

Oh  H 


Cl 


<D 


CJ  P 
re  re 

S 

1 1 

0D 


C-2 


u 

X 

5 

x 

w 

p- 

O, 

< 


GO 

o 

2 

< 

z 

w 

u 

GO 

OiJ 

W 

CO 

tJ 

P 

o 

O 

CO 

|Jh 

CO 

p 

H 

O 

z 

C 

§ 

(Li 

X 

OJ 

a 

CO 

3 

o 

a 

1 

co 

.2 

Tj 

g 

cO 

Oh 

a) 

c 

j 

< 

'3 

G" 

p 

c 

u 

C/3 

o 

g 

z 

1 

np 

X 

u 

g 

w 

o 

H 

a> 

S 

8 

CxJ 

x1 

H 

CO 

GO 

X 

s 

GO 

/-s 

o 

CQ 

•J* 

co 

8 

W 

g 

H 

ai 

P 

O 

1) 

w. 

H 

g 

Z 

J 

O 

■j3 

S 

»-> 

o 

HH 

2 

’o 

OQ 

•S 

hJ 

W 

5 

H 

CO 

§ 

(D 

B 

co 

B 

a> 

g 

o 

Z 

H 

*3 

w 

a* 

GO 

a> 

« 

*-1 

o 

J3 

< 

H 

g 

O 

L-* 

C 

pc. 

o 

> 

u 

a 

% 

2  £ 

o  ° 

■sif 

S  > 


1  S 
2  ra 
p  <u 
3  F- 
> 

*3 

■S 


<U  <D 

H  | 


?  5 
<* 


O 


a 


„  -S 

-3  <u 

O  S 
U 


i.B  i, 

%  s  g  w 
ai  a° 

_  fc  _  <L> 

K  O  C3  Ol 

1  £  I 

4)  I 


X  p  X 

lij  h  id 


b  E  o 

r  *  ~ 

<I>  X  <1> 

*  ®  a 

OT!  3 


C  CO  <D 

leg 

t;  <d  o 
w  3 


2  *eo  o  O 
G*  £  & 

*2  a>  3  £-■ 
E  c  £  § 
«>  •— 1  S3  o 
t?  ^  «  “ 
Who 


~*a  S 
^6 


ill’s 

i*s  b  E 

E  c  -w 

2  ~  g 

,  * 

'W 


s_S 

%  co 

5l  r“  4) 

O  r~  o 

a-S  £ 
la  H  o 

E  b  “ 

fj  C  D 

x  b  * 

W  O 

cl 


£  p 

o  o 
o. 


jo 

o  <u 
«  tS 
r  co 

130  £L 


■U 

Q 

!fi 

a3  ^  oi 

^  §  o 

<2  1  = 


00 

o 

hJ 


c 

§ 


£  eo 

E-S 

§  s 

B  c 
o  .2 
*3  3 
.£  13 

ll 


a  « 

3  3 


PS  «o> 
JO  <N 

<G  £ 

3  P 
O  o 
—  <s 


|<*w  »n  p 

— •  a>  w 
CL 


*  «/-*  • 


B  -.  ~| 

i||r| 

ss  I  2  c  •« 
-S  S  |  2 

o  <3 

cj  CL 


l-s 

r- 


<M  >'">  O 
O  p,  co 

•s  »>  S 

■C  »  O- 

M  a 
|f  If 

V  o  £ 

u  s 


_o 
'b« 
-a 

5:1 


ts 

O  . 


•f  - 

C  ' 
*  i 
T3  ; 


S  2 

P  « 
co  «■ 

r-  CO 

■C 
« 

'  cl 

I 

g 

I  8 

•  2  co 


co 

o 


b 

< 


b 

< 


CU 

pH 

o 

s 


Ch 

eu 

I 


b 

Oh 

Ph 

i 


PU 

1 


o  S> 

5  |  5 

_r  <u  p 

1  g  s 
5  C  ■S 

roxi  ^ 
d  £  2 
^  53  o 
W  o-  « 

*3  °  *o 

§  d  s 
5* 


£  S 

x: 

U 


6 

a> 


o 

2 


>  to  .  O 
£  c  p 
3  .2  O  g 

.£  >3  TJ  CO 

»  g  §  « 

X)  y  O  o> 
!“  X  O  E 

>  .£?  c  § 


■a 


^  c  ^ 
g  coO 
o  c  ^ 
h  o  -a 

.a  s  s 

22  *2  o 
x  g  ^ 

CO  O 


?  C  p 

°,2b 
-S  =6  -g 

o  g  3 

a§s 

.2  Jc  o 
>  §  c 


^  *d 

•as 

jr  o 

CO 

£  O 

.2  c  . 

G  cor  j 


|! 

>  R 


a> 


1)  g 

US  S  to 
^  1)  3 

O 


P 

-  o 

b  § 


.S  'oo 
c  -g 
8  © 


^  §  S‘2 
■r  -in  o 
b  g  g  g 
>>  o  c 


co  _ 

11 
o  8 


o  C 


o 


op  -g  p  P  O 
^  ..«  c  .2- 


X)  _2  cu  \ 
.3  CO  cu  g  ■ 

tJ  CO  CO  O  ■ 
O  r 
CL  *- 

:r  a> 

CO  g3 


CO  CO 

co  is 


!  « 
p 


c 
o 


rO  CO 

^  — .  JD 

<U  .S  S  = 
a>  .  >  o 

">  ^22  Tf 

D  C  C  ]f> 

o  (L»  O  35  _ 
■r  op-  3  p 

&  .g  s  «  b 
•°  3  -s  s 

•a  °  to  b 
■3  O  c  g 

£  2  E  *> 

«  o  a> 

■H  TJ 


s  W  O 


h  .a ' 

'w  •§  ; 
(U 


<N  V 


Ibf  s 

3  J5  3  tn 
3  £  •§  £ 

u  3  - 

g  (U 

^  a 


«  p 

3  o 


^  X  X 

n  2  i 
« 

rrj  TJ  T3 
u  «u  a» 

g^-g 
3  b  S 

■Sks 


•a 


O  0) 

a  & 


i 


_  ‘-P 
p  .2 

-2  g 

CO  4^ 

b  2 

f-l  CO 
n  ^ 
Ph  co 
X3 

u 


b 

CO 


-  >  « 
^  e  « 

o  -S  c2 
5  ■g  ^ 
■3  a  g 


sa«i 

>  •-  o 

o>  to  2 

^  s  a 

*'  °  £ 

O  TJ 


a» 

^  o 


C-3 


_ APPENDIX  C _ 

ENVIRONMENTAL  SENTINEL  BIOMONITOR  (ESB)  SYSTEM  TECHNICAL  REQUIREMENTS  FOR  USER  SCENARIOS 

Notes:  "T"  means  threshold  or  minimum  requirement;  "O"  means  objective  or  maximum  requirement  (01  is  a  higher  priority  than  02) 

Category _ Tech.  Requirements  Scenarios 
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APPENDIX  D 


ADDITIONAL  INFORMATION  ON  MILITARY  EXPOSURE  GUIDELINES 

Military  Exposure  Guidelines  (MEGs)  are  provided  for  water  (and  other  media)  to  estimate  a 
level  above  which  certain  types  of  health  effects  may  begin  to  occur  in  individuals  amongst 
the  exposed  population”.  MEGs  are  designed  to  indicate  ‘thresholds’  for  minimal  to  no 
adverse  health  effects”  and  are  considered  protective  against  any  significant  non-cancer 
effects”.  MEG  exposure  scenarios  for  water  are  appropriate  for  a  deployed  military  operation, 
i.e.,  exposure  lasting  either  5  or  14  days,  with  water  consumption  of  either  5  or  15  L/day.  The 
exposed  population  is  defined  to  include  “. . .  relatively  healthy  and  fit  male  and  non-pregnant 
female  adults”,  18  to  55  years  old  with  and  average  weight  of  70  kg.  It  is  important  to  note  that 
while  MEGs  are  not  enforceable  military  standards,  the  MEGs  are  considered  guideline 
concentrations  for  identifying  and  ranking  Occupational  and  Environmental  Health  (OEH)  risks. 
MEGs  have  been  established  for  about  190  chemicals.  MEGs  provide  a  reference  point  above 
which  adverse  effects  may  be  expected  after  a  field-relevant  period  of  exposure  and  may  serve  as 
lower  thresholds  for  toxicity  sensor  responses.  That  is,  responses  at  concentrations  below  the 
MEGs  indicate  toxic  effects  that  may  not  be  relevant  to  acute  human  health  impairments. 

Reference:  U.S.  Army  Center  for  Health  Promotion  and  Preventive  Medicine.  2001.  Chemical 
Exposure  Guidelines  for  Deployed  Military  Personnel.  TG-230.  U.S.  Army  Center  for  Health 
Promotion  and  Preventive  Medicine,  Aberdeen  Proving  Ground,  MD. 
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APPENDIX  F 


EXAMPLE  OF  AN  ENVIRONMENTAL  SENTINEL  BIOMONITOR  (ESB)  SYSTEM 

TECHNOLOGY  FACT  SHEET 

Microtox,  Deltatox 


(1)  Technology  description 

a.  Vendor 

Strategic  Diagnostics  Inc. 

1 1 1  Pencader  Drive,  Newark  DE  19702-3322  USA 

Sales:  (800)  544-8881  Tel:  (302)  456-6789  Fax:  (302)  456-6782 

(http://www.sdix.com/ProductSpecs.asp  ?nProductID=7) 

b.  Toxicity  sensor  type 

i.  Living  system  used:  Vibrio  fischeri  (luminescent  bacteria) 

ii.  Endpoint  monitored:  Inhibition  of  light  output  or  toxicity  threshold;  light 
is  produced  as  a  byproduct  of  cellular  respiration. 

iii.  Monitoring  method 

1.  Freeze-dried  bacteria  are  reconstituted  in  salt  solution  containing 
water  sample  to  be  tested 

2.  Luminescence  readings  are  taken  prior  to  and  at  5  and  15  min. 
after  water  sample  addition 

iv.  Continuous  monitoring  or  grab  sample?  Grab  sample 

v.  Note:  Microtox  and  Deltatox  generally  produce  similar  results;  Deltatox 
is  designed  to  be  field  portable  and  lacks  the  temperature  control 
capabilities  of  Microtox. 

(2)  Logistical  considerations 

a.  Environmental  requirements:  Testing  done  in  salt  water  solution;  temperature  is 
maintained  at  15  deg.  C;  ambient  temperatures  must  be  15-30  deg.  C. 

b.  Storage  and  transport:  Shelf  life  of  freeze-dried  bacteria  1  year  when  stored  at  -20 
to  -25°  C;  less  at  normal  refrigerator  temperatures. 

c.  Sample  throughput:  Microtox:  15  samples  per  hour;  Deltatox:  20  per  hour 

d.  Cube  and  weight:  Microtox:  1.0  ft3;  21  lbs;  Deltatox:  0.2  ft3,  6  lbs 

(3)  Response  to  toxic  chemicals  (EPA  ETV  report  available) 

a.  Chemicals  tested:  extensive  database;  see 
http://www.sdix.com/pdf/Toxicity%20Data%20Index.pdf;  also  tested  as  part  of 
MEIC  in  vitro  cytotoxicity  evaluation  program;  see  graphs  on  next  page 

b.  Toxicity  data: 

i.  ETV  results:  no  inhibition  up  to  human  lethal  levels  for  botulinum  toxin, 
ricin,  soman,  and  VX;  aldicarb,  colchicine,  cyanide,  dicrotophos,  and 
thallium  were  detected  at  or  below  lethal  levels 

ii.  Response  relative  to  human  lethal  values  and  MEGs:  See  graph  on  next 
page 

c.  Test  precision:  Range  of  test  standard  deviations  from  ETV  evaluation  were  most 
less  than  10%. 

d.  Interfering  substances  and  water  conditions: 
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i.  Samples  must  be  dechlorinated  before  testing;  chloraminated  water  may 
interfere  after  dechlorination 

ii.  Turbid  and  colored  samples  may  require  pre-treatment;  pH  outside  range 
6.0  -  8.0  requires  adjustment 

iii.  ETV  testing  showed  copper  and  zinc  to  cause  interferences 
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Microtox  Toxicity  Data 


Human  Lethal  Chemical  Number 


Lethal  doses  for  50  chemicals  (Wallum,  1998)  are  plotted  in  order  of  increasing  toxicity 
as  concentrations  in  water,  assuming  a  70  kg  person  consuming  5  L  of  water.  Military 
Exposure  Guidelines  (MEGs)  for  water  (5  day,  5  L/day)  are  available  for  15  of  the  50 
chemicals  (USACHPPM,  2001).  Microtox  data  from  Kaiser  and  Palabrica,  1991. 
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Effect  level  (log  mg/L) 


Microtox  Toxicity  Data  -  5  min  data  from  MEIC 


Human  Lethal  Chemical  Number 


Lethal  doses  for  50  chemicals  (Wallum,  1998)  are  plotted  in  order  of  increasing  toxicity 
as  concentrations  in  water,  assuming  a  70  kg  person  consuming  5  L  of  water.  Military 
Exposure  Guidelines  (MEGs)  for  water  (5  day,  5  L/day)  are  available  for  15  of  the  50 
chemicals  (USACHPPM,  2001).  Microtox  data  from  Clemedson  et  al.,  1996,  1998. 
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5-30  min  Effect  Level  (log  mg/L) 


Military  exposure  guidelines  (MEGs)  for  water  (5  day  exposure,  5  L/day  consumption) 
for  169  chemicals  (USACHPPM,  2001)  are  plotted  in  order  of  increasing  toxicity. 
Corresponding  human  lethal  concentrations  derived  from  lethal  dose  levels  (Wallum, 
1998)  are  available  for  15  of  the  169  chemicals  and  assume  a  70  kg  person,  5  L 
consumption.  Microtox  data  from  Kaiser  and  Palabrica,  1991. 
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APPENDIX  G 


ENVIRONMENTAL  SENTINEL  BIOMONITOR  (ESB) 

SYSTEM  DOWNSELECT  STRAWMAN  MODEL  GOALS  AND  MEASURES 

Note:  This  is  a  working  document  (4-22-04  version)  and  is  not  complete.  The  model  goals, 
measures,  scales,  and  criteria  weights  will  be  finalized  after  all  needed  data  from  the  additional 
tests  become  available.  We  do  this  because  the  testing  result  differences  between  each  ESB  system 
are  critical  to  how  the  model  is  set-up  (e.g.,  if  there’s  no  difference  between  the  ESB  technologies 
for  one  criterion,  using  this  criterion  does  not  help  in  the  decision  making  process). 

The  numbers  within  the  parenthesis  refer  to  the  numbers  in  the  ESB  system  technical  requirements 
for  user  scenario  document  (e.g.,  4  is  “what’s  the  level  of  detection  for  each  chemical”,  this  is  a 
performance  criteria;  see  Appendix  3). 

1.  Performance  -  how  well  does  the  technology  work? 
a.  Chemicals  Detected: 


i.  (3,  4)  The  ability  of  the  technology  to  provide  an  adverse  response  to  a 
set  of  representative  chemicals  at  concentrations  closest  to  the  short-term 
MEG  for  the  greatest  number  of  test  chemicals,  without  being  above  the 
lethal  level  or  appreciably  below  the  MEG.  It  is  better  to  respond  to  the 
greatest  number  of  chemicals  closest  to  each  short-term  MEG  without 
responding  appreciably  below  the  MEG  or  above  the  lethal  level.  Need 
to  weight  certain  chemicals  more  based  on  modes  of  action,  what  is 
important  to  users  [e.g.,  CNS].  Needs  to  be  finalized.  A  false  negative 
is  more  suitable  to  the  user’s  need  than  a  false  positive  (individual 
soldier  scenario). 

Same  for  all  4  scenarios 
Scale: 

100  -  x  Chemicals 
0  -  x  Chemical 

The  list  of  chemicals  will  reflect  the  prioritization  set  by  the  users.  We 
have  to  keep  in  mind  what  the  filtration  system  will  remove  from  the  water 
per  scenario. 

b.  Water  Characteristics: 

i.  (6,  7)  The  ability  to  operate  under  a  number  of  water  quality  conditions 
and  in  the  presence  of  interfering  substances  (e.g.,  quantity  of  total 
dissolved  solids,  turbidity,  chlorine  residual,  ammonia,  and  metals  [e.g., 
copper],  pH,  temperature)  with  minimal  effect  on  test  outcome.  It  is 
better  to  be  able  to  operate  under  a  wide  range  of  water  quality 
conditions  than  under  a  more  restricted  range. 

Same  for  all  4  scenarios,  assumes  reasonable  sample  preparation  for  all 
scenarios  except  for  individual  soldier  scenario  (they  will  do  no 
preparation) 
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Better  method:  (scoring  should  reflect  ability  plus  ease  of  correctability 
[must  carry  through  requirements  to  other  measures  within  model]) 

Considering  these  factors  -  cations,  copper,  ammonia,  chlorine, 
chloramines,  coagulants,  dissolved  solids,  turbidity/clay,  pH,  temp,  the 
experts  will  use  this  scale: 

1 00  -High,  means  able  to  operate  under  a  wide  range  of  conditions 
0  -  Low,  means  able  to  operate  under  a  very  restricted  range  of 
conditions 


c.  Reliability 

i.  Technology  Failure  Rate  ( 1 7)  The  number  of  times  a  technology  fails  to 
produce  a  result  per  a  certain  number  of  tests.  By  failure  we  mean  the 
technology,  not  a  human  mistake.  It  is  better  to  have  fewer  rather  many 
failures. 

May  be  a  measure  for  an  ESB  system,  not  for  individual  technologies. 
All  scenarios. 

Scale: 

100-  means  a  low  failure  rate 
50  -  Medium 

0-  means  a  high  failure  rate 

ii.  Test  Reproducibility  (20)  Need  definition.  It  is  best  to  have  high 
reproducibility. 

For  all  scenarios 

Scale: 

100-High 

50-Medium 

0-Low 

iii.  Operational  Indicator  ( 1 5)  Technology  includes  an  indicator  to  show  that 
it  is  operational.  It  is  better  if  the  technology  system  has  an  automatic 
malfunction  signal  rather  than  a  manual  or  more  elaborate  method  to 
detect  a  malfunction  or  a  system  not  working  properly.  Assume  all 
technologies  have  an  operational  indicator? 

For  all  scenarios 

Scale: 

100-has  operational  indicator,  easy  to  use  (automatic) 

50-  has  operational  indicator,  not  easy  to  use 
0-  does  not  have  an  indicator 

iv.  Positive  Control  Indicator.  Positive  control  is  essential  in  fixed  base 
scenario.  Need  to  develop  definition. 
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For  all  scenarios 
Scale: 

1 00-has  positive  control  indicator,  easy  to  use  (automatic) 
50-  has  positive  control  indicator,  not  easy  to  use 
0-  does  not  have  an  indicator 

2.  Operational  Impact  -  how  does  the  technology  impact  other  operations? 
a.  Test  Turn  Around  Time 


i.  (23,  24)  The  time  required  between  consecutive  tests  (assumes  reusable 
technology).  Includes  operator  set-up  time,  sample  preparation,  sensor 
operation  time,  and  any  time  required  for  the  system  to  reset  before 
another  reading.  It  is  better  to  have  less  rather  than  longer  time 
required  to  perform  tests.  If  it  takes  more  than  30  minutes  this  would 
earn  a  very  low  score  for  the  IS  scenario. 

IS  Scenario 

Scale: 


100-  20  Seconds  (or  best  technology) 
0-  1 .5  Minutes  (or  worst  technology) 

FB-FC-MGV  Scenario 
Scale: 


1 00-  7  Minutes 
0-15  Minutes 


b.  Environmental  Conditions 


i.  (5)  The  range  of  environmental  conditions  under  which  the  technology 
can  properly  operate.  These  conditions  include  air  temperature,  and  the 
humidity  level’s  operable  range  for  the  technology.  It  is  better  to  be 
able  to  operate  under  all  environmental  conditions  and  extremes. 

FB-FC-MGV  Scenario 
Scale: 

100-  High,  means  able  to  operate  under  a  wide  range  of 
conditions  (User  will  refine  temperature  and  humidity 
requirements) 

0-  Low,  means  able  to  operate  under  a  very  restricted 
range  of  conditions 

IS  Scenario 
Scale: 

100-  High,  means  able  to  operate  under  a  wide  range  of 
conditions  (5-95%  RH  &  0-45C) 

0-  Low,  means  able  to  operate  under  a  very  restricted 
range  of  conditions  ( 
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Better  method:  (scoring  should  reflect  ability  plus  ease  of  correctability 
[must  carry  through  requirements  to  other  measures  within  model]) 

Considering  these  factors  -  ambient  operational  temperature 
(most  important  factor),  relative  humidity 


c.  Ease  of  Use 


/'.  Sample  Preparation  and  Skills  Required  (22.  26.  27)  The  sample 
preparation  and  performing  test  complexity  level  (e.g.,  measured 
volume,  reagent  addition).  The  focus  is  not  on  how  long  it  takes  to 
perform  each  task  but  rather  how  complicated  each  task  is.  It  is  better 
for  the  tasks  to  be  simple  (a  soldier  can  perform)  rather  than  complex  (a 
technician  must  perform).  It  is  better  for  the  tasks  to  be  simple  (a  soldier 
can  perform)  rather  than  complex  (a  technician  must  perform  at  a 
depot). 

FB-FC  Scenario 
Scale: 


100-  few  steps  of  preparation,  minimal  skill  level 
80  (place  holder)-  some  steps  of  preparation,  moderate 
skill  level  (NCO  and  above,  water  technician  with  lab 
skills  and  lab  capabilities) 

0-  many  steps  of  preparation,  significant  skill  level 
(senior  water  technician  with  lab  skills  and  lab 
capabilities) 

IS-MGV  Scenario 
Scale: 

1 00-  no  sample  prep,  minimal  skill  level  (does  not  have 
to  think  about  it,  can  be  trained  [15  minutes  of  training 
or  less] 

0-  some  sample  prep,  a  little  more  than  minimal  skill 
level  (does  not  have  to  think  about  it,  can  be  trained  [15 
minutes  of  training  or  less] 

ii.  Ease  of  Data  Interpretation  (25)  The  ease  of  making  the  data 

interpretable  (go/no-go  vs.  look  up/analysis).  It  is  better  to  have  test 
results  that  are  not  ambiguous. 

FB-FC  Scenario 
Scale: 

100-  Go/No-go,  test  results  that  are  not  ambiguous 
50- 

0-  Moderate  look  up/analysis  (lab  technician  skills  and 
experience  would  be  required,  soldier  must  go  to  a 
reference  to  look  up  result) 

IS-MGV  Scenario 
Scale: 


1 00-  Go/No-go,  test  results  that  are  not  ambiguous 
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50- 

0-  Minimal  look  up/analysis  (interpret  a  numerical 
reading) 


3.  Logistics 

a.  Size  and  Weight 

i.  (9,  12)  The  cube,  maximum  length,  and  weight  of  the  technology  and 
necessary  peripheral  equipment  (e.g.,  maintenance  and  repair  supplies 
and  parts,  power  source,  and  a  2-week  supply  of  consumables).  It  is 
better  for  the  overall  weight  and  cube  to  be  less  rather  than  more.  Max. 
-  perform  8  tests  per  day  per  person  (individual  soldier  scenario). 

FB-FC-MGV  Scenario 
Scale: 

100-less  than  or  equal  to  1.5  cu  ft,  less  than  or  equal  to 
12.5  lb 

50-  1.5-3  cu  ft,  12.5-25  lb 
25  -.... 

0-  more  than  6  cu  ft,  more  than  40  lb 

IS  Scenario 

Scale: 

100-8  oz  or  less,  3”x3”x2” 

0-greater  than  a  16  oz,  bigger  than  6”x8”xl0” 

b.  Ruggedness  (May  want  to  delete  this  GOAL  and  just  have  Shelf  Life  as  “c”) 

i.  Shelf  Life  (18)  The  storage  life  of  the  technology  and  consumables  (i.e., 
how  long  will  they  be  usable  [includes  shipping  time]  and  under  what 
conditions  must  they  be  stored).  It  is  better  when  the  technology  and  its 
consumables  have  a  long  shelf  life  and  there  are  minimum  storage 
requirement/restrictions. 

FB  Scenarios 
Scale: 


1 00-  more  than  6  months,  under  these  conditions 
(without  a  environmental  control  required) 

80-  more  than  6  months,  under  these  conditions  (with 
environmental  control  required) 

40-between  30-days  and  6  months,  under  these 
conditions  (with  environmental  control  required) 

0  -  less  than  5-day,  under  these  conditions  (with 
significant  environmental  control  required) 
FC-MGV-IS  Scenarios 
Scale: 


100-  more  than  6  months,  under  these  conditions 
(without  a  environmental  control  required) 

0  -  less  than  30  day  (includes  2-weeks  shipping),  under 
these  conditions  (must  perform  without  environmental 
controls) 
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c. 


System  Maintenance 


i.  Time  complexity  and  materiel  required  to  maintain  test  system.  Want 
minimum  requirements  for  organism  culture. 

FB  Scenario 
Scale: 

1 00-  requires  no  biological  culturing 
0-  requires  continuous  biological  culturing 

FC  Scenario 
Scale: 

100-  requires  no  biological  culturing 

0-  limited  maintenance  of  culture  (e.g.,  media 

replacement) 

MGV-IS  Scenarios  (this  is  a  screening  tool) 

Scale: 


1 00-  requires  no  biological  culturing 
0  -  requires  any  biological  culturing 

4.  Programmatics  (Recommend  evaluate  subsequent  to  model  application) 

a.  Maturity/Risk 

i.  How  mature  is  this  technology  (e.g.,  Technology  Readiness  Level  [need 
to  send  TRLs  to  everyone])?  Are  there  a  lot  of  data  gaps  for  this 
technology?  Can  the  data  be  obtained,  or  does  a  lot  of  testing  still  have 
to  be  done  to  acquire  it?  How  likely  would  a  high  success  rate  be  for 
this  technology? 

Scale: 

100- 

0- 

b.  Cost 

i.  How  costly  would  this  technology  be  to  fund/develop?  Are  there  a  lot  of 
costs  involved  for  the  testing  process  (cost  per  test,  not  to  include 
consumables)?  Are  there  a  lot  of  costs  involved  with 
supporting/peripheral  equipment/protective  gear?  Development  cost 
(filling  in  data  gaps,  etc),  reoccurring  annual  costs  (cost  per  test  (variable 
costs),  storage  costs  (fixed/sunk  costs),  etc),  and  life-cycle. 

Scale: 

100- 

0- 

User  technical  requirements  not  within  model: 

Screening  threshold  questions:  1  (grab  vs.  continuous)  -  scenario  dependent, 
recommend  focusing  on  (grab)  requirement  only 
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Taken  out  of  model  (not  to  be  used  for  any  screening): 

21  -  taken  out  of  model  because  group  does  not  believe  it  is  critical/a  discriminator. 

10,1 1  -  Ease  of  Controls/Displav  (10,  11)  How  easy  it  is  to  prepare  and  perform  the  tests  to 
include  using  the  technology’s  controls  (e.g.,  dials,  switch,  knob)  and  reading  the  display 
(be  able  to  read  the  results)  in  low  light  conditions  while  wearing  and  working  in  protective 
and  cold  weather  suits.  The  easier  and  less  time  consuming  to  perform  these  tasks  the 
better.  This  is  an  engineering  issue?  -  taken  out  of  model  because  group  does  not 
believe  it  is  critical/a  discriminator 

16  -  Consecutive  Tests  Performed  (16)  The  number  of  tests  that  can  be  completed  before 
reloading  or  recalibration  of  the  technology  (assumes  reusable  technology).  It  is  better  to 
have  many  rather  than  fewer  tests  that  can  be  performed  before  reloading  or  any 
maintenance  function,  taken  out  of  model  because  group  does  not  believe  it  is  critical/a 
discriminator 

13  -  Water/Impact  Resistance  (13)  The  ability  of  the  technology  to  produce  usable  results 
after  it  is  immersed  in  water  for  30  minutes  or  is  dropped  onto  concrete  from  a  height  of  3 
feet  (can  we  limit  this  consideration  to  just  the  individual  soldier/small  team  and 
MGV  scenarios?).  It  is  better  for  the  technology  to  function  after  immersion  in  water  or 
after  being  dropped.  Is  this  more  of  an  engineering  issue?  taken  out  of  model  because 
group  does  not  believe  it  is  critical/a  discriminator. 

2  -  (fixed  vs.  sliding  scale)  -  recommend  focusing  on  threshold  (fixed  level)  requirement 
only. 

19  -  (safety,  health,  and  environment)  -  not  likely  to  be  useful  as  a  discriminator  between 
technologies. 

14  -  Potential  for  Carryover  Effects  (14)  The  ability  of  the  technology  to  not  allow 
cumulative  exposure  to  TICs  to  produce  a  false  positive  result  (assumes  reusable  or 
continuous  technology).  It  is  better  when  cumulative  exposures  to  TICs  do  not  produce  a 
false  positive  result.  Another  concern  is  the  “masking”  effect.  The  technology  has  been 
exposed  to  a  masking  TIC  and  has  been  “effected”  so  it  does  not  detect  like  it  did  prior  to 
being  exposed  to  the  masking  TIC.  Cannot  get  needed  information  within  next  6-12 
months. 

8  -  Power  Requirements  (8)  The  amount  and  source  of  electrical  power  (e.g.,  ampere, 
watts)  required  for  the  technology  for  two  weeks  of  operation.  It  is  better  to  have  less 
power  required  and  the  ability  to  use  battery  along  with  other  power  sources.  May  only  be 
a  measure  for  individual  soldier  scenario  and  field  operations.  Logisitcs  of power  source 
is  covered  in  size  and  weight  measure.  Focus  of  measure  should  only  be  on  how  power  is 
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required  and  not  the  source  of  the  power  (renewable,  replaceable).  It’s  best  for  the 
technology  to  not  require  any  power. 

ESB  System  Strawman  Model  (next  page! 

Notes:  Weights  are  only  given  as  examples.  User  representatives  have  not  addressed 
weights  for  goals  or  measures  yet.  The  user  representatives  will  finalize  the  model  after 
test  results  for  the  9  ESB  system  technologies  being  considered  become  available  in  FY05. 
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Blank 
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APPENDIX  H 


EVALUATION  METHOD  FOR  ENVIRONMENTAL  SENTINEL  BIOMONITOR  (ESB) 
SYSTEM  HIGH-LEVEL  QUALITATIVE  MODEL 

Evaluation  Method:  A  two-step  process  will  be  used.  The  first  step  is  to  reduce  the  number  of 
technologies  for  further  consideration  and  then  to  rate  and  then  rank  the  remaining  technologies 
(or  top  20). 

Step  1 :  Rate  each  ESB  technology  using  the  rating  categories  below. 

Rating  Categories: 

Green  -  means  the  technology  is  promising.  Final  rating  and  ranking  will 
be  completed  in  step  2. 

Orange  -  means  the  technology  may  be  promising  at  some  point  but  (and) 
the  technology  is  currently  immature  and  needs  more  R&D  (e.g.,  the 
technology  is  not  to  the  point  in  development  where  testing  can  be 
completed  to  determine  toxicity  sensitivity).  The  technology  will  not  be 
considered  in  step  2  but  is  put  on  a  technical  watch  list. 

Red  -  means  the  technology  is  not  promising  or  not  reasonably  projected  to  ever  be  promising.  A  technology 
earns  a  red  rating  for  any  of  the  reasons  below  and  is  eliminated  from  further  consideration. 


-  Technology  toxicity  sensitivity  is  inappropriate  or  the  technology  does  not  provide  a  unique  end¬ 
point  (i.e..  metabolic,  physical  response) 

-  Technology  is  redundant  and  inferior  to  another  technology. 

-  Technology  is  unfeasible/not  viable.  It  does  not  or  is  not  expected  to  meet  a  minimum  requirement 
of  a  user  scenario. 

-  Technology  takes  too  much  time  (hours)  to  produce  an  end-point. 

—  Technology  requires  pre -culturing  (e.g.,  requires  actively  taking  out  and  culturing  organism 
for  a  long  period  of  time) 


Step  2:  Evaluate  all  technologies  that  were  rated  green  in  step  1 .  Rate  each  ESB 
technology  against  the  criteria  and  rating  categories  below.  After  each  technology  is 
rated  then  rank  the  technologies  (1-n). 

Rating  Categories: 

Green  -  means  the  ESB  technology  is  known  to  or  is  expected  to  perform 
“well”  against  this  criterion’s  requirements  or  is  “likely”  to  achieve  this 
criterion’s  requirements. 

Yellow  -  means  the  ESB  technology  is  known  to  or  is  expected  to  perform 
only  “ok”  against  this  criterion’s  requirements  or  “may”  achieve  this 
criterion’s  requirements. 

Red  -  means  the  ESB  technology  is  known  to  or  is  expected  to  perform 
“poorly”  against  this  criterion’s  requirements  or  is  “not  likely”  to  achieve 
this  criterion’s  requirements. 
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Evaluation  Criteria  (see  note  1): 


-  Technology  provides  an  appropriate  toxicity  sensitivity  response  (SR) 
and/or  provides  unique  information  (e.g.,  unique  end-point). 

-  Technology  is  only  minimally  affected  by  interferences  (I).  Interferences 
are  turbidity,  color,  and  ionic  composition  of  the  media. 

-  Technology  is  reliable/repeatable  (R&R). 

-  Technology  has  an  appropriate  rapidity  of  response  (RoR).  A  green 
rating  is  20  min  or  less,  yellow  is  20-60  min,  and  red  is  over 

60  min. 

Note  1 :  Ranking  decisions  are  based  on  the  ability  of  the  technologies  to  meet  at 
least  one  of  the  user  scenarios.  The  focus  is  primarily  on  appropriate  toxicity 
response  -  at  the  correct  level  of  sensitivity,  in  a  reasonable  period  of  time,  and 
with  the  reproducibility  and  absence  of  interferences  necessary  to  reach  an 
appropriate  evaluation  of  a  test  sample. 
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APPENDIX  I 

HIGH-LEVEL  QUALITATIVE  MODEL  AND  ASSESSMENT/RESULTS  FOR  ENVIRONMENTAL  SENTINEL  BIOMONITOR 

(ESB)  SYSTEM  TECHNOLOGIES 
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APPENDIX  J 


INFORMATION  ON  SELECTING  TRAINING/TEST  CHEMICALS  AND 
LIST  OF  TRAINING/TEST  CHEMICALS 

Information  on  Selection  of  Training/Test  Chemicals: 

Considering  the  thousands  of  toxic  industrial  and  agro-chemicals,  an  appropriate 
evaluation  of  toxicity  sensor  performance  requires  careful  initial  selection  of  the 
chemicals  to  be  evaluated.  Some  possible  criteria  for  selecting  test  chemicals  include: 

•  Threat  chemicals.  Several  organizations  (U.S.  Environmental  Protection  Agency 
(EPA),  U.S.  Army  Research  Development  and  Engineering  Center  (ARDEC)) 
and  publications  (Garland,  1991;  Hickman,  1999;  Clark  and  Deininger,  2000) 
have  developed  lists  of  threat  chemicals  for  water  supplies.  Typically,  the  higher 
priority  chemicals  are  highly  toxic,  soluble,  persistent  in  water,  and  available  in 
the  region  of  concern.  Chemicals  high  on  these  lists  should  be  given  priority  as 
test  chemicals  for  toxicity  sensors. 

•  Mode  of  toxic  action.  Some  chemicals  can  be  grouped  together  because  they 
cause  similar  effects  on  organisms.  Examples  include  organophosphorus  and 
carbamate  insecticides  (which  cause  acetylcholinesterase  inhibition)  and  many 
neutral  organic  chemicals  such  as  industrial  solvents  (which  cause  narcosis).  To 
the  extent  that  chemicals  can  be  grouped  in  this  way,  it  should  be  possible  to 
select  one  or  two  representative  chemicals  from  the  group  for  testing  to  establish 
whether  a  toxicity  sensor  will  respond  to  chemicals  exhibiting  the  same  general 
mode  of  toxic  action. 

•  Chemical  structural  classes.  Chemicals  with  certain  structural,  functional,  or 
other  similarities  are  frequently  grouped  together  for  testing  purposes,  such  as 
heavy  metals,  algal  toxins,  or  herbicides.  Since  chemicals  within  these  groups 
may  have  distinctly  different  modes  of  toxic  action,  it  is  best  to  emphasize  mode 
of  toxic  action  categories  in  the  selection  of  test  chemicals.  The  MEIC  chemical 
list  provides  a  broad  range  of  both  modes  of  toxic  action  and  chemical  structural 
classes  (Clemedson  et  al.,  1996,  1998). 

•  Interfering  chemicals  or  water  quality  conditions.  Interfering  chemicals  include 
substances  commonly  found  in  raw  or  treated  water  that  may  cause  toxicity  sensor 
responses  at  levels  far  below  concentrations  affecting  humans,  such  as  residual 
chlorine,  copper,  or  ammonia.  In  addition,  acceptable  ranges  of  common  water 
quality  conditions,  such  as  temperature,  dissolved  oxygen,  conductivity,  pH, 
turbidity,  and  microbial  concentrations  need  to  be  defined  for  toxicity  sensors  to 
help  minimize  “false  positive”  responses. 

Given  the  broad  range  of  potential  test  substances,  a  compromise  must  be  reached 
between  minimizing  the  number  of  chemicals  to  conserve  resources  and  expanding  the  number 
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to  better  define  toxicity  sensor  response  characteristics.  One  possible  solution  is  the  use  of  a 
tiered  approach  -  conduct  an  initial  screening  of  several  toxicity  sensor  technologies  with  a  few 
chemicals,  followed  by  more  thorough  evaluation  of  technologies  showing  the  most  promise. 

List  of  Training/Test  Chemicals: 

Chemicals  are:  Aldicarb  *,  Ammonia,  Copper  Sulfate,  Mercuric  Chloride  *, 
Methamidophos  *,  Nicotine  *,  Paraquat  Dichloride  *,  Pentachlorophenol  *,  Phenol, 
Sodium  Arsenite  *,  Sodium  Cyanide  *,  and  Toluene. 

Notes:  means  it  is  a  user-selected  chemical 

The  responses  of  each  toxicity  sensor  to  residual  chlorine  and  a  high  conductivity 
freshwater  sample  will  be  determined  as  well. 
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APPENDIX  K 

TEST  PLAN  TO  GATHER  NEEDED  DATA:  TOXICITY  SENSOR  TESTING  TASK 


Background.  The  U.S.  Army  Center  for  Environmental  Health  Research  (USACEHR)  is 
developing  an  Environmental  Sentinel  Biomonitor  (ESB)  system  to  provide  rapid  toxicity 
identification  for  a  broad  spectrum  of  chemicals  in  water.  As  part  of  a  technology  downselection 
effort,  an  expert  panel  has  identified  several  toxicity  sensors  as  candidates  for  inclusion  in  an 
ESB  system.  To  help  select  the  best  toxicity  sensors  for  use  in  an  ESB  system,  USACEHR  seeks 
to  have  these  sensors  tested  against  a  common  set  of  test  chemicals. 

Purpose.  This  task  will  provide  essential  toxicity  response  information  to  15  chemicals 
(provided  as  blind  samples)  for  one  toxicity  sensor. 

Government-provided  materials.  Through  a  contractor,  the  Government  will  provide  15 
chemicals  to  be  tested  (furnished  as  blind  samples)  and  instructions  for  providing  test  data. 

Task  requirements.  The  following  items  are  to  be  provided  under  this  task. 

1.  A  detailed  protocol  submitted  for  approval  prior  to  testing  initiation.  Detailed 
instructions  will  be  provided  later,  but,  at  a  minimum,  the  protocol  will  include: 

a.  Description  of  sample  handling  procedures. 

b.  Test  methodology  to  be  followed,  including  QA/QC  procedures. 

c.  Exposure  period,  endpoints  monitored,  and  statistical  methods  used  to  generate 
endpoint  data.  The  endpoint  value(s)  must  be  generated  for  at  least  one  exposure 
interval  of  60  minutes  or  less,  and  the  same  exposure  intervals  must  be  used. 

2.  For  each  of  the  1 5  blind  samples  received  from  the  contractor: 

a.  Conduct  one  range-finding  test  based  on  log  dilutions  of  a  stock  solution  made 
from  the  sample  provided.  The  range-finding  test  will  bracket  the  test 
concentrations  to  be  used  in  the  definitive  tests. 

b.  Conduct  three  separate  definitive  tests  to  establish  the  response  endpoints  defined 
in  the  protocols.  At  least  five  concentrations  should  be  tested  within  the  log 
interval  determined  in  the  range-find  test.  [If  an  endpoint  response  is  not 
achieved  using  the  undiluted  blind  sample  in  the  range-find  test,  confirm  this  in  a 
definitive  test  using  only  the  blind  sample  concentration.] 

c.  Prepare  sample  solutions  to  be  used  in  testing  by  dilution  in  distilled  water.  If  a 
defined  culture  medium  is  required  for  testing,  a  twice  concentrated  medium 
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d.  should  be  diluted  50%  with  the  test  sample  to  be  evaluated.  If  distilled  water 
cannot  be  used  as  a  diluent  and  a  specific  culture  medium  is  not  specified, 
reconstituted  soft  water  medium  may  be  used  (see  table  below).  Tap  water  or 
well  water  must  not  be  used  in  sample  preparation  or  testing. 

e.  Provide  results  from  each  test  conducted,  including  endpoint  responses  and 
concentrations,  exposure  period(s),  and  applicable  statistical  confidence  limits. 

Deliverables:  Approved  test  protocol  for  each  toxicity  sensor  and  completed  test  results  for  each 
toxicity  sensor  and  chemical  tested. 

Recommended  Composition  of  Soft  Reconstituted  Freshwater  (if  required) 


Chemical 

Concentration  (mg/L) 

48 

CaS04  2  H20 

30 

MgS04 

30 

KC1 

2.0 

Characteristics:  pH  after  aeration  -  7.3  to  7.5;  hardness  (mg/L,  as  CaCC^)  -  40  to  48;  alkalinity 
(mg/L,  as  CaC03)  -  30  to  35. 

Reference:  Marking,  L.L.  and  V.K.  Dawson.  1973.  Toxicity  of  quinaldine  sulfate  to  fish. 
Investigations  in  Fish  Control,  No.  48,  U.S.  Fish  and  Wildlife  Service,  Washington,  DC. 
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